-- Logs begin at Mon 2022-10-31 18:41:49 UTC, end at Mon 2022-10-31 19:42:18 UTC. -- Oct 31 19:07:05.533730 dv-cinder-863097-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 31 19:07:05.540933 dv-cinder-863097-1-smb devstack@keystone.service[81445]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 19:07:05 2022] *** Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: nodename: dv-cinder-863097-1-smb Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: machine: x86_64 Oct 31 19:07:05.542930 dv-cinder-863097-1-smb devstack@keystone.service[81445]: clock source: unix Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: pcre jit disabled Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: detected number of CPU cores: 4 Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: current working directory: / Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: detected binary path: /usr/bin/uwsgi-core Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: your processes number limit is 47680 Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: your memory page size is 4096 bytes Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: detected max file descriptor number: 2048 Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: lock engine: pthread robust mutexes Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: thunder lock: enabled Oct 31 19:07:05.543306 dv-cinder-863097-1-smb devstack@keystone.service[81445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 31 19:07:05.543891 dv-cinder-863097-1-smb devstack@keystone.service[81445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 19:07:05.585368 dv-cinder-863097-1-smb devstack@keystone.service[81445]: Python main interpreter initialized at 0x5587334f79c0 Oct 31 19:07:05.585368 dv-cinder-863097-1-smb devstack@keystone.service[81445]: python threads support enabled Oct 31 19:07:05.585368 dv-cinder-863097-1-smb devstack@keystone.service[81445]: your server socket listen backlog is limited to 100 connections Oct 31 19:07:05.585368 dv-cinder-863097-1-smb devstack@keystone.service[81445]: your mercy for graceful operations on workers is 90 seconds Oct 31 19:07:05.585737 dv-cinder-863097-1-smb devstack@keystone.service[81445]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 19:07:05.585824 dv-cinder-863097-1-smb devstack@keystone.service[81445]: *** Operational MODE: preforking *** Oct 31 19:07:05.586090 dv-cinder-863097-1-smb devstack@keystone.service[81445]: *** uWSGI is running in multiple interpreter mode *** Oct 31 19:07:05.586090 dv-cinder-863097-1-smb devstack@keystone.service[81445]: spawned uWSGI master process (pid: 81445) Oct 31 19:07:05.586297 dv-cinder-863097-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 31 19:07:05.592484 dv-cinder-863097-1-smb devstack@keystone.service[81445]: spawned uWSGI worker 1 (pid: 81457, cores: 1) Oct 31 19:07:05.592484 dv-cinder-863097-1-smb devstack@keystone.service[81445]: spawned uWSGI worker 2 (pid: 81458, cores: 1) Oct 31 19:07:05.592484 dv-cinder-863097-1-smb devstack@keystone.service[81445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 19:07:09.882714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:07:09.882714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: from cryptography.utils import int_from_bytes Oct 31 19:07:09.883472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:07:09.883472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: from cryptography.utils import int_from_bytes Oct 31 19:07:09.888994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:07:09.888994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Oct 31 19:07:09.889455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:07:09.889455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Oct 31 19:07:09.933167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:07:09.933356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:07:09.933554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] command line args: [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:07:09.933824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:07:09.934002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ================================================================================ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:07:09.934769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] admin_token = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.935089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_dir = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.935356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.935639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_source = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.935822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] debug = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.936023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.936554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.936655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.936840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.937091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.937323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.937502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_config_append = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.937680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.937882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_dir = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.938032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.938266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.938430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:07:09.938556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.938676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:07:09.938801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.938918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] command line args: [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:07:09.939035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:07:09.939272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ================================================================================ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:07:09.939510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_dir = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.939976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_source = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940449 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] debug = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.940847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.941842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_config_append = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] publish_errors = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_dir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.942867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943759 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] standard_threads = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.943877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944003 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_journal = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_json = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.944932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_stderr = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_syslog = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.945740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.945840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.945955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.946074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.946186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.946306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.946306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.946528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.946647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.946825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] publish_errors = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.946825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.947044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.947157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.947274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.947385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.947508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.947621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.947738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.947850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.947960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.948077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] standard_threads = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.948199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.948312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.948423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.948560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.948680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.948792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.948916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.949035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_journal = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.949035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_json = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.949252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.949364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_stderr = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.949480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.949965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_syslog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.950601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.950713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:07:09.950831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.950947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.951980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.952927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.953927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.954956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.955966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.956896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.957926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.958911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.959943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.960892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.961976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.962894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.963917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.964962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.965913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.966757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.967997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.968940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.969953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.970964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.external = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971759 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.971983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.password = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.token = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.972952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.973903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.974943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.975988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.external = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.976932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.password = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.token = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.977944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.978958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.979951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.980919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.981986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.982998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.983942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.984943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.985996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.986920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.987951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.988893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.989916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.990960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.991984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992327 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.992962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.993997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.994921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.995956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.996690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.997484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.997614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.997731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.997845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.997958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.998846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:09.999994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.000939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.001989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.002904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.003945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.004928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.005853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.006909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.007934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.008994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.009908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.010946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.011964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.012077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.012200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.012315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.013914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.014921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.015974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.016906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.017823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.018935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.019944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:07:10.020775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.020775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.021189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.021189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.021399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.021511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.021778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.022012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.022257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.022521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.022783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.023026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.023275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.023515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.023758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.023995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.024233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.024484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.024733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.024979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.025217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.025463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.025701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.025951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.026188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.026433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.026664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.026946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.027140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:07:10.027313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:07:10.048745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.048973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.049193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.053198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.053433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.053658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.057760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.062841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.087669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.087898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.089587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.089823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.140236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.141100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.189627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.189858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.190293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.190530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.342633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.342816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.342960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.343838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.366796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.366974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.367936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.368065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.368147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.368275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.379428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.379533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.392754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.392933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.393911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.394041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.394122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 19:07:10.410726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.410933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 19:07:10.411016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.411188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 19:07:10.411268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.411457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 19:07:10.411552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.411713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 19:07:10.411794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.411982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.412062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.412242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.412324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.412521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.412779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.413044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.424407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.424712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.426062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.426341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.426988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.427272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.427543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.427827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.433709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.435975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.437281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.437567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.437852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.438135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.438417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.438678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.438916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.439010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.439830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.440013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.440094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.440270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.440577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.440854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.441241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.441516 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.441788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.462615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.464076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.464357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.464552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.466058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.466341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.469387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.469672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.469954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.472782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.473070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.473354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.476274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.476585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.479960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.480251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.482770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.483064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.483350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.483632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.483906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.484179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.484449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.484738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.484995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.485289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.485576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.485872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.486163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.486447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.486717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.486996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.500822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.501096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.503166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.503447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.504968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.507335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.508175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.508494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.510593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.510894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.512895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.515180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.516025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.518342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.519249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.519551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.519833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.520114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.520390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.520704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.521601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.521905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.522194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.522491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.522786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.523078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.537049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.537332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.537598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.537857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.539385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.539675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.539949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.540213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.545376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.546902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.547897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.548447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.548746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.549481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.551295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.551580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.551660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.551898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.552181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.552478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.552877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.554246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.554535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.554922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.555209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.555501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.564517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.564803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.565086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.565365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.565754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.566042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.566329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.567737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.568025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.568408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.568719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.569016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.569312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.569588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.582187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.585097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.585675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.588052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.588599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.589515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.591544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.591824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.592089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.592238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.593604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.595177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.595464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.595750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.598573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.600030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.602147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.602894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.603284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.603570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.603648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.603849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.607183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.607469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.607753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.608031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.612301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.612615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.612895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.615871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.616161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.616443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.619744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.620027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.620309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.620680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.620956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.621230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.621505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.622396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.622638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.622917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.623187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.623464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.623807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.624107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.624974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 19:07:10.625264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.625552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.625831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.626104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.626376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.626650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.626938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.627209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.627626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.627915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.628191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.628482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.628749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 19:07:10.658378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587334f79c0 pid: 81458 (default app) Oct 31 19:07:10.661667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1cc5-758f-422f-9822-6cfdb12903e4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:10.661954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1cc5-758f-422f-9822-6cfdb12903e4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:10.662226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1cc5-758f-422f-9822-6cfdb12903e4 None None] PATH_INFO: `/v3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:10.662788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587334f79c0 pid: 81457 (default app) Oct 31 19:07:10.666379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Oct 31 19:07:10 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:17.478411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:17.478934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:17.479045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:17.483273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:17.488603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:17.489135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:17.489135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:17.560443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: INFO dbcounter [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] Registered counter for database keystone Oct 31 19:07:17.579682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:07:17.585945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writer thread running {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:07:17.761706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 19:07:17.762030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 19:07:17.820917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:17.822531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:17.948403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 19:07:18.241354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:18.311445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: INFO dbcounter [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] Registered counter for database keystone Oct 31 19:07:18.332724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG oslo_db.sqlalchemy.engines [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:07:18.338965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writer thread running {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:07:18.460063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645782-b0c6-40e9-b1bc-15fcc80bcc9a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:18.464413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:18.465657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:18.465933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:18.466208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:18.474435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:18.524770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 19:07:18.525292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a5545-51c2-4dd2-ab35-21fb5fd83732 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:18.534846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 31 19:07:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 19:07:18.540904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:18.557894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c450db-f99a-4cfb-b47f-d0a08838d2c3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:18.562825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:18.563926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:18.564208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:18.564507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] PATH_INFO: `/v3/projects/aefddd72ecfc4b63a01173e7a0408933` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:18.566072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] RBAC: Authorizing `identity:get_project(project_id=aefddd72ecfc4b63a01173e7a0408933)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:18.618329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 19:07:18.618677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f800-4caa-4604-af32-3b1ac1915597 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:18.623370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:07:18 2022] GET /identity/v3/projects/aefddd72ecfc4b63a01173e7a0408933 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:20.745204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428dd55-134d-4a7c-a8e0-586acc83debd None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:20.745871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428dd55-134d-4a7c-a8e0-586acc83debd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:20.745871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428dd55-134d-4a7c-a8e0-586acc83debd None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:20.750646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:20.756007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:20.756420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:20.756583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:20.776683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:20.778263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:20.786135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 19:07:21.059400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428dd55-134d-4a7c-a8e0-586acc83debd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:21.072003 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428dd55-134d-4a7c-a8e0-586acc83debd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:21.077245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:21.077854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:21.078137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:21.078412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:21.085956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:21.087732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820306b8-b588-4cca-b0d5-871982c36b5c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:21.096737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 31 19:07:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:07:21.102197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:21.111170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5cb4c-4176-4c01-bc49-b0b62d2d2b53 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:21.115431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:21.116050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:21.116332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:21.116643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] PATH_INFO: `/v3/users/c283501180e146e19c1574f09f326f1e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:21.117939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] RBAC: Authorizing `identity:get_user(user_id=c283501180e146e19c1574f09f326f1e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:21.119765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec24a9-b29b-4bd2-a71f-d6ba4b6bb13a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:21.121833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Oct 31 19:07:21 2022] GET /identity/v3/users/c283501180e146e19c1574f09f326f1e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:23.321678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f13e-7853-4280-b1b3-ace9f8ee1c1a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.322228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f13e-7853-4280-b1b3-ace9f8ee1c1a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.322228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f13e-7853-4280-b1b3-ace9f8ee1c1a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.323551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:23.329313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.329749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.329873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.347763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:23.348960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:23.371767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5372-b4e9-44a2-8f3b-eddb1e4e8004 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.371970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5372-b4e9-44a2-8f3b-eddb1e4e8004 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.372133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5372-b4e9-44a2-8f3b-eddb1e4e8004 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.374023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:23.379723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.380013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.380296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.423738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG passlib.handlers.bcrypt [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81457) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 19:07:23.424132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG passlib.handlers.bcrypt [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81457) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 19:07:23.433030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:23.473242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:23.474824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:23.573431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:07:23.700140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:23.725359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:23.805765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b5f4-7248-440e-823d-3e6b9037bad1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:23.840644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:23.841215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.841494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.841765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.849742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:23.852754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:23.861826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:23.862790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:23.863652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:23.868836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:23.949733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ece3-e754-40c0-b3c2-ebe75b7a2b26 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:23.950254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:23.952384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:23.969031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead3e0-f1a2-4779-9280-87f11faf4b15 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:23.988833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:23.989695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:23.989978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:23.990251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:23.991215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:23.992660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.004394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.sql.core [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:07:24.004394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:07:24.004394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [parameters: {'id': 'dc3b6e5f4ff44d7abc6bf7a462466b22', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 19:07:24.004394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 19:07:24.004944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.005556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.005839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.006116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.006786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:24.007090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.008489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.020523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:07:24.022819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 19:07:24.023653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application yield resource Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise self.value Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application session.commit() Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 19:07:24.024583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.flush() Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application compat.raise_( Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 19:07:24.025425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 19:07:24.026308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:07:24.027755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [parameters: {'id': 'dc3b6e5f4ff44d7abc6bf7a462466b22', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 19:07:24.028942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:24.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.030633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 31 19:07:23 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:07:24.031399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:24.034127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:24.129784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60009ff-6984-428e-bd9b-0fae39ca2d36 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:24.135128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae350d-6608-4322-99dd-de1fa231a048 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:24.163861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.164645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.164932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.165210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] PATH_INFO: `/v3/users/c283501180e146e19c1574f09f326f1e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.166345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c283501180e146e19c1574f09f326f1e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.167902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.167995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.168866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.169147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.169416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.169496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:24 2022] GET /identity/v3/users/c283501180e146e19c1574f09f326f1e => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:24.175195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:24.188351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.189839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.191986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:07:24.206037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:24.207070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:07:24.207882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:07:24.207882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:07:24.207882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:24.207882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:07:24.212923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:24.236699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:24.278121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94435609-f6d0-44a8-b2d7-87fbb68e50c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:24.311160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.311782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.312110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.312321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.313456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.314910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.315508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7c289-7838-4430-8fc2-98aed56cb038 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:24.316427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:24.322043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:24.354184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.354840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.355152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.355342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.355980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:24.356286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.357704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f71cd-22e0-4483-946a-87fb4cbe5e06 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.375567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:24.406017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:24.427809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0453c-aa5e-4d70-9978-99a171e8a551 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:24.465021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:24.465864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:24.466160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:24.467519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] PATH_INFO: `/v3/domains/default/users/c283501180e146e19c1574f09f326f1e/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:24.470639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c283501180e146e19c1574f09f326f1e, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:24.472109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df46ea8-99cc-46d0-baa6-bcaefb35b3eb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:24.590468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Oct 31 19:07:24 2022] PUT /identity/v3/domains/default/users/c283501180e146e19c1574f09f326f1e/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:07:27.155856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356b47-300f-46a0-b5b1-f2e10ef394c9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.156344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356b47-300f-46a0-b5b1-f2e10ef394c9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.156344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356b47-300f-46a0-b5b1-f2e10ef394c9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.157690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:27.175316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95255aae-6844-4a0c-839d-70de47af8bc3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.176275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95255aae-6844-4a0c-839d-70de47af8bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.176795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95255aae-6844-4a0c-839d-70de47af8bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.202755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-95255aae-6844-4a0c-839d-70de47af8bc3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:27.204740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95255aae-6844-4a0c-839d-70de47af8bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:27.307512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:27.324971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce5b6-c184-412b-bab8-ec81f8fe9307 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.325275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce5b6-c184-412b-bab8-ec81f8fe9307 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.325525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce5b6-c184-412b-bab8-ec81f8fe9307 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.327222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:27.345402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407805-3bfa-4d7e-9fd4-a766a3e64076 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.346032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407805-3bfa-4d7e-9fd4-a766a3e64076 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.346513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407805-3bfa-4d7e-9fd4-a766a3e64076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.368891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-41407805-3bfa-4d7e-9fd4-a766a3e64076 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:27.371180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-41407805-3bfa-4d7e-9fd4-a766a3e64076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:27.373306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e729f0-82dc-4a89-a038-8e4eb964327e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.373604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e729f0-82dc-4a89-a038-8e4eb964327e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.374789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e729f0-82dc-4a89-a038-8e4eb964327e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.375274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:27.380677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e9ad-49ca-4159-b9bc-59f867f25566 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.380965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e9ad-49ca-4159-b9bc-59f867f25566 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.381244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5e9ad-49ca-4159-b9bc-59f867f25566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.415931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f2a5e9ad-49ca-4159-b9bc-59f867f25566 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:27.418473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f2a5e9ad-49ca-4159-b9bc-59f867f25566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:27.537190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:27.542786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:27.544812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:27.633869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75037c-ae76-4f4d-aa91-139d3fbf7b9e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.634270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75037c-ae76-4f4d-aa91-139d3fbf7b9e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.634645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75037c-ae76-4f4d-aa91-139d3fbf7b9e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.636712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:27.642314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.642799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.643253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.673947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:27.675689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:27.779044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 14/29] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:27.801812 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75037c-ae76-4f4d-aa91-139d3fbf7b9e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:27.820487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:27.925478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75037c-ae76-4f4d-aa91-139d3fbf7b9e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:27.949178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:27.972663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:27.973306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:27.973590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:27.973869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:27.990744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:27.992239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:07:28.015187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:28.016091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:07:28.016924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:07:28.016924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:07:28.016924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:28.016924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 16/30] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:28.023631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.136928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:28.161743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183051c2-1fac-408b-b362-0fe7bcbb1e59 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.182297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7f6e-8c3d-4ace-89c8-3f58e1f38432 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.195436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:28.204777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.205405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.205687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.205967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.207254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:28.209455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.223638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.224960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.225323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.225975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.226748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:28.227340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:28.228894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.236799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 15/31] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 19:07:27 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:28.238375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.242917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:28.243782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.458991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf0138-fcf6-4121-97e7-38d87efa7cc5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.462400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef034dd-447a-42ba-b9d7-a3a10c06465b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.497315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:28.513484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.514469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.514958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.515428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.516553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:28.518847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b9228-111b-4dfc-9c63-6e2335331a30 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.522870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.523520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.523807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.524090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.538950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:28.545034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:28.545863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:28.546654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:28.547256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.606087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:28.650978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 18/34] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 19:07:28 2022] POST /identity/v3/roles => generated 219 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:28.653205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6896f4-ca28-4833-b3a7-40cf2f68bfc9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.653499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6896f4-ca28-4833-b3a7-40cf2f68bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.653831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6896f4-ca28-4833-b3a7-40cf2f68bfc9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.655247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 19/35] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:28.660215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6896f4-ca28-4833-b3a7-40cf2f68bfc9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.679557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6388e-5a70-4a9a-a5bd-8ab6734aadec None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.723900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.724242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.724574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.724856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.725644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:28.727215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12afad-e3f0-4062-9187-f04cc640dfda None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.765697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 17/36] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:07:28 2022] POST /identity/v3/projects => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:28.770316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09642e6-5513-456a-9117-68b73d28ba70 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.771017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09642e6-5513-456a-9117-68b73d28ba70 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.771520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09642e6-5513-456a-9117-68b73d28ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.830195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d09642e6-5513-456a-9117-68b73d28ba70 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:28.833013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d09642e6-5513-456a-9117-68b73d28ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:28.853294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6896f4-ca28-4833-b3a7-40cf2f68bfc9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:28.906541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:28.907222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.907503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.907779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.908555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:28.908871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:28.910463 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6366-e50c-4e9e-a7aa-7a9bfc8d97ab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:28.928872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 20/37] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:28.930418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb60-e8f8-4456-a0f2-b25593fa2c9b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.930714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb60-e8f8-4456-a0f2-b25593fa2c9b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.930995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb60-e8f8-4456-a0f2-b25593fa2c9b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.932382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:28.933395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cb60-e8f8-4456-a0f2-b25593fa2c9b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:28.934929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 18/39] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:28.953054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:28.953355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:28.953624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:28.976072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:28.978436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:28.992026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:29.011109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:29.068216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cb60-e8f8-4456-a0f2-b25593fa2c9b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.108607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.109266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.109549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.109826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] PATH_INFO: `/v3/users/c283501180e146e19c1574f09f326f1e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.111362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=c283501180e146e19c1574f09f326f1e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.112872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.114513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 22/40] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:28 2022] GET /identity/v3/users/c283501180e146e19c1574f09f326f1e => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:29.120110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:29.173303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:07:29.219417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:29.229261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991485c0-115e-4bdc-937d-4e71201ee7b7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.243925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:29.267797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.268434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.268748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.269036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.270248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.271698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.273565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 23/42] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:29.279462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:29.333357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d0756-26da-4ee2-aab2-9b3ef16a4849 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.370750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.371519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.371872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.372151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.373140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.374535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.388347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c9ecc-6e13-4296-888c-cf5b1cd2d5c1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.390050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 20/43] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 19:07:29 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:07:29.430273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.430910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.431195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.431474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.432226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.domain.id=default, user.id=c283501180e146e19c1574f09f326f1e) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:29.432604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.434091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.441688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:29.458923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 24/44] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Oct 31 19:07:29 2022] GET /identity/v3/role_assignments?user.id=c283501180e146e19c1574f09f326f1e&scope.domain.id=default&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 530 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:29.472617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:29.575352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7a782-703c-4942-8f2b-d3251e8422f6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.616002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.616738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.617020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.617293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.618461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.619951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742750a-3be3-49ef-82a2-481aa872c048 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.621793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 21/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:29.627565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:29.682599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:29.737873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4128a-69da-4571-981c-027694f7e4a5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:29.771814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:29.772434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:29.772757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:29.773040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:29.773711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:29.775183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da229d61-e33e-4224-9ad2-239f1b8c215d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:29.803921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 25/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:07:29 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:31.929208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a569cf-8d40-4530-af96-effc3162a008 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:31.929741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a569cf-8d40-4530-af96-effc3162a008 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:31.929741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a569cf-8d40-4530-af96-effc3162a008 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:31.931077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 22/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:31.936612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:31.937026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:31.937172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:31.955513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:31.957038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:32.020831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:32.287825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a569cf-8d40-4530-af96-effc3162a008 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:32.379345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:32.390592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a569cf-8d40-4530-af96-effc3162a008 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:32.423467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:32.424092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:32.424377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:32.424935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:32.426056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:32.427506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0240f-e790-4c64-a35c-974953b079e9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:32.429090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 23/49] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:32.435167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:32.461252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:32.534100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e4316-219f-492b-b190-48a1f1ce1b68 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:32.566977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:32.567521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:32.567805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:32.568085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:32.568758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:32.570210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aa37b-bcd1-42f4-bd01-2f13d99a4347 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:32.595748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 27/50] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 31 19:07:32 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:34.831785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311106-8853-457d-be00-a3217c2764c0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:34.832327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311106-8853-457d-be00-a3217c2764c0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:34.832431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db311106-8853-457d-be00-a3217c2764c0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:34.833781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 24/51] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:34.839902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:34.840338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:34.840497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:34.860345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:34.861885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:34.936788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 28/52] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:35.222818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db311106-8853-457d-be00-a3217c2764c0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:35.323496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db311106-8853-457d-be00-a3217c2764c0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:35.355998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:35.356647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:35.356931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:35.357206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:35.358310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:35.359759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b3e0f-80e7-4714-b453-dd7175589a98 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:35.361333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 25/53] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:35.366984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:35.378225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:35.568605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5067f4-4d31-4d7a-a6ec-841a5e44b1e6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:35.600557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:35.601156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:35.601434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:35.601717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:35.602357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:35.603791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ebc6-5347-4cb1-bcbd-f11c841291c4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:35.631142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 29/54] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:35 2022] POST /identity/v3/users => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:38.696428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf62-b5d8-47bf-8d27-08adccb0900a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:38.697493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf62-b5d8-47bf-8d27-08adccb0900a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:38.698021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf62-b5d8-47bf-8d27-08adccb0900a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:38.700376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 26/55] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:38.705679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e51-4013-4774-a8b1-ccb98da36762 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:38.706540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e51-4013-4774-a8b1-ccb98da36762 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:38.707025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e51-4013-4774-a8b1-ccb98da36762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:38.733487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2ce12e51-4013-4774-a8b1-ccb98da36762 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:38.735027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2ce12e51-4013-4774-a8b1-ccb98da36762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:38.814416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:38.827127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 30/56] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:39.306713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bb96-d9cc-43dd-ad82-f90cd25f763e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.307431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bb96-d9cc-43dd-ad82-f90cd25f763e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.307950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bb96-d9cc-43dd-ad82-f90cd25f763e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.309592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 27/57] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:39.315447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da67c0-355c-4730-af3c-d6f5f3e37789 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.316063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da67c0-355c-4730-af3c-d6f5f3e37789 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.316611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da67c0-355c-4730-af3c-d6f5f3e37789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.324380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45bb96-d9cc-43dd-ad82-f90cd25f763e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:39.366607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-30da67c0-355c-4730-af3c-d6f5f3e37789 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:39.368128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-30da67c0-355c-4730-af3c-d6f5f3e37789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:39.374724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:39.441826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:39.443078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2550-528d-4b27-ad5e-d3ee871437c0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.443366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2550-528d-4b27-ad5e-d3ee871437c0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.443639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b2550-528d-4b27-ad5e-d3ee871437c0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.445022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 32/59] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:39.450547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be2e4-0311-47ce-adfe-ea8b036c53ff None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.450828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be2e4-0311-47ce-adfe-ea8b036c53ff None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.451108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be2e4-0311-47ce-adfe-ea8b036c53ff None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 33/60] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a547e-e818-4faa-a6d2-f464dd7f55fc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a547e-e818-4faa-a6d2-f464dd7f55fc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a547e-e818-4faa-a6d2-f464dd7f55fc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 34/61] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:39.456437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69abd-6b1d-48d4-a812-f3d90d5acbca None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.456875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69abd-6b1d-48d4-a812-f3d90d5acbca None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.456938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69abd-6b1d-48d4-a812-f3d90d5acbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.459653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45bb96-d9cc-43dd-ad82-f90cd25f763e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:39.474906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7af69abd-6b1d-48d4-a812-f3d90d5acbca None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:39.476085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7af69abd-6b1d-48d4-a812-f3d90d5acbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:39.498399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:39.499245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.500084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.502152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.513294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a19b1ce0-e445-4428-9de9-2bfa7374dab1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:39.518673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:39.519517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:39.520251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:39.521344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 28/62] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:39.522615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.523227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.523511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.541339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:39.543682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:39.546559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 35/63] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:39.553673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.554174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.554721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.574806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:39.576445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:39.615135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 29/64] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:39.621479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:39.632138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:39.655134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 36/65] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:39.656737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:39.719053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:39.792671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7ad1b-37fc-48b1-a9ad-c09e02429788 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:39.846906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:39.848247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.849016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.849494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.850623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:39.851578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:39.853793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:39.866239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 30/66] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:39.868141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:39.871093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a069474-87a0-47ef-b1c1-dc59e639afdc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:39.909902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:39.910985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:39.911406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:39.911818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:39.926999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:39.935740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:39.936604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:39.937358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:39.939735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 37/67] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:39.940744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:39.974489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:39.992818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:39.997960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59367ca7-bbe2-44bc-9e8b-fa6224d0552c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.035859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.036520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.036808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.037088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.048272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:40.052662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89da1d-7a0c-4514-ac41-5dcaa0ec042f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:40.053429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:40.054310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:40.055213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 31/68] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:40.055976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.088386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.089702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.090034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.090311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.105813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.107312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.108987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 38/69] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:39 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.109745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.160593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f6c4-9d2d-4f49-8a14-8695f5b53001 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.193876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.194479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.194765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.195037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.195691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:40.195994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.197423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.202978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.206570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 32/70] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.207032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d3b2-cc6b-4a1c-b328-be448f890eed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.207868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.208574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.244265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.244920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.245312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.246208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.247326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.248923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.250478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 39/71] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.251240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.308851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb163-4842-464c-804c-c0115ee0793a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.341972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.342602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.342886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.343162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.347846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e07e5-9380-407a-abe2-ac352f56ed19 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.353001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:40.358994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:40.359852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:40.360629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 33/72] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:40.361443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.385506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.386800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.387089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.387369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.388037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:40.388346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.389771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.397974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 40/73] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.398757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.419775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.431046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.461857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e198d-5183-42ab-b6e6-bb7e1ec31de3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.495416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.496095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.496377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.496683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.497815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.499277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.500932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 34/74] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.501677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.506022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410103-e833-4a40-9e6c-7b20dc7bba38 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.541599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.542279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.542566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.542861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] PATH_INFO: `/v3/users/c283501180e146e19c1574f09f326f1e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.543997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] RBAC: Authorizing `identity:get_user(user_id=c283501180e146e19c1574f09f326f1e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.545473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.547022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 41/75] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/users/c283501180e146e19c1574f09f326f1e => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.547782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.609994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b61a-13d6-47e0-a0b5-d4e1516c44dc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.637126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.645246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.645863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.646155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.646442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.647092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.648610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.649728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.652872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1cdb-78d4-47de-99a2-5b3b0a17f472 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.674835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 35/76] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:40 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:40.675747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.689672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.690364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.690652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.690992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.691694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:40.692034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.693523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.706620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 42/77] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.707484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.809088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c945b90-feae-4323-a9f2-9e43a095ada4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.837689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37327a02-6a53-4e78-af91-4bd2f2941f49 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:40.847847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.848524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.848804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.849083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.850236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.851697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.853319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:40.854304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.883832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:40.884421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:40.884732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:40.885032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/25ec2169aa074182a0582fc390a13413/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:40.888130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, user_id=25ec2169aa074182a0582fc390a13413, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:40.889285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:40.908620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 43/79] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:40 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/25ec2169aa074182a0582fc390a13413/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:40.909455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:40.918530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.938747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:40.992733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5eb1-9044-49be-984f-014a12157ec3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.035380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.036026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.036311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.036638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.037896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.039426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.041548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 37/80] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:41.042952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:41.053018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d9a6-799f-4fe6-bfc7-9effae905531 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.097875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.098602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.098999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.099286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.100528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.102132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.103911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 44/81] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:40 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:41.105231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:41.166397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcff35-4b94-4cbb-b945-5675980c31a1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.195009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:41.215093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:41.215935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.216981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.217285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.217570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] PATH_INFO: `/v3/projects/4b71cbf599324fe59d7c5d01c991e238` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.219201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] RBAC: Authorizing `identity:get_project(project_id=4b71cbf599324fe59d7c5d01c991e238)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.221311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.223815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 38/82] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:41 2022] GET /identity/v3/projects/4b71cbf599324fe59d7c5d01c991e238 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:41.228486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:41.233198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a54e9-8f6a-4cde-a3c1-29c8b1312dc9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.275470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.277044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.277559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.278184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/c283501180e146e19c1574f09f326f1e/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.281456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, user_id=c283501180e146e19c1574f09f326f1e, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.283888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.319242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 45/83] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:41 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/c283501180e146e19c1574f09f326f1e/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:41.320178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:41.363391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78e09-6dff-4a5d-a558-92fe249c06e6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.412116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.414385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.414886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.415377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.417062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.420434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.423855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 39/84] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:41 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:41.430422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:41.564900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b16d59-efbb-4518-abf0-de1da2db9fec None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.587579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:41.636714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.637135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.637423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.637704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] PATH_INFO: `/v3/projects/4b71cbf599324fe59d7c5d01c991e238/users/25ec2169aa074182a0582fc390a13413/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.645884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b71cbf599324fe59d7c5d01c991e238, user_id=25ec2169aa074182a0582fc390a13413, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.647366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27e29d-a1e6-4d4f-99af-79012a0256b2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.655162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a776-b44d-4e03-80ac-28febfc27362 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:41.687104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 46/85] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:41 2022] PUT /identity/v3/projects/4b71cbf599324fe59d7c5d01c991e238/users/25ec2169aa074182a0582fc390a13413/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:41.710492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:41.711170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:41.711463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:41.711745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/25ec2169aa074182a0582fc390a13413/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:41.718711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, user_id=25ec2169aa074182a0582fc390a13413, role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:41.720202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d60cf4-63f7-4687-a149-d6a1f62b4aa2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:41.741805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 40/86] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:41 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/25ec2169aa074182a0582fc390a13413/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:43.594512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21438471-877a-4134-954a-689f75f93c81 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:43.595026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21438471-877a-4134-954a-689f75f93c81 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:43.595099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21438471-877a-4134-954a-689f75f93c81 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:43.596543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 47/87] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:43.602040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a72b-46b7-4e93-a801-66363d588637 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:43.602435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a72b-46b7-4e93-a801-66363d588637 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:43.602612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645a72b-46b7-4e93-a801-66363d588637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:43.628891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6645a72b-46b7-4e93-a801-66363d588637 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:43.630093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6645a72b-46b7-4e93-a801-66363d588637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:43.719691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 41/88] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:44.072829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969260c-2a91-4829-8f66-2bd3a0aeeceb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.073667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969260c-2a91-4829-8f66-2bd3a0aeeceb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.074024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969260c-2a91-4829-8f66-2bd3a0aeeceb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.075371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 48/89] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:44.084838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.085133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.085413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.109471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:44.110671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:44.159994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:44.213342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74839-a0a0-4fbf-b285-586817bc8578 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.213682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74839-a0a0-4fbf-b285-586817bc8578 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.213974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74839-a0a0-4fbf-b285-586817bc8578 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.215318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 49/90] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:44.216150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 42/91] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:44.220332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.220644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.220925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.250872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:44.257494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:44.258725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:44.266054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:44.376619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edb584-9d06-43ae-8970-96ec28110265 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:44.414392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 50/92] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:44.443984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:44.445011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.445488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.445954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.469092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:44.486497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:44.487347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:44.488085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:44.490709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 43/93] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:44.497202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:44.644935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4fd5f-130f-4c3e-887d-d39100b7d3a0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:44.694201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:44.694840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.695130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.695408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.696096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:44.696401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:44.697827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:44.711446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 51/94] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:44.718521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:44.774985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:44.833914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:44.840137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:44.859635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ccdc3-dc77-48bc-b001-22586eaf197e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:44.890523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:44.891189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:44.891470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:44.891746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] PATH_INFO: `/v3/users/bcdb42eefba442338fa9795ec44fe29e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:44.906804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] RBAC: Authorizing `identity:get_user(user_id=bcdb42eefba442338fa9795ec44fe29e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:44.908824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:44.910877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 44/95] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:44 2022] GET /identity/v3/users/bcdb42eefba442338fa9795ec44fe29e => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:44.911852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:44.987628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f7de1-81fa-46b1-8f84-4a53698a355f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.017265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.025189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc451f0c-3aef-4237-b433-d294a2099705 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.026646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.027277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.027556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.027831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.037822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-05945d0f-f073-4235-9ccb-0633c73c13f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:45.043423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:45.044248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:45.045037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 52/96] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:07:45.046067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d845-a28e-476b-a734-b1246cbee1c8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.046067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d845-a28e-476b-a734-b1246cbee1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.046250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32d845-a28e-476b-a734-b1246cbee1c8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.047419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 53/97] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:45.050132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7cb-7fa0-4119-8a37-086986006089 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.050132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7cb-7fa0-4119-8a37-086986006089 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.050132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db7cb-7fa0-4119-8a37-086986006089 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.050675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 54/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:45.051371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db7cb-7fa0-4119-8a37-086986006089 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.080907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.082120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.082766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.083540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.085263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.086919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.090159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 45/99] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:45.091138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.116178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.160250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db7cb-7fa0-4119-8a37-086986006089 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.197917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.198785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.199071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.199347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.199527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05007c45-f74d-4c87-8832-b646342673cf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.200508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.202231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d7d8b-b7ef-4dec-9b35-98829cfcca0e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.208612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 55/100] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:45.208612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.208612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.208612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.224665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:45.225834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:45.236953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.237566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.237849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.238125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.238788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:45.239092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.240554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e113fd-df68-451c-86fa-9e1f7c7da664 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.250324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 46/101] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:45.250324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.250324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.250324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.272346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:45.273611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:45.293138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.320482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 56/102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:45.320482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.358559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 47/103] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:45.359408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.406145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.437269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8dd8-d1c6-48dd-bc37-0d874863a3fd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.483340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.484587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.485344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.486232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.487364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.488719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e9582-4d0c-40bd-be0b-cd37df7ac797 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.489287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.528828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 57/104] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:07:45 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:45.530102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.541404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.542170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.542452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.542778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/bcdb42eefba442338fa9795ec44fe29e/roles/bc7efaa1905c48e8982df8bf24a173e2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.545961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, user_id=bcdb42eefba442338fa9795ec44fe29e, role_id=bc7efaa1905c48e8982df8bf24a173e2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.547707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b32e-2880-4927-8709-63527b269f4e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.573457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 48/105] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:45 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/users/bcdb42eefba442338fa9795ec44fe29e/roles/bc7efaa1905c48e8982df8bf24a173e2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:45.574950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab586f5-12a9-4d25-a4da-bedce8103800 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.575236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab586f5-12a9-4d25-a4da-bedce8103800 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.575561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab586f5-12a9-4d25-a4da-bedce8103800 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.577096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 49/106] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:45.586778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.587096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.587452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.625688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:45.626915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:45.652310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.699426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c72287-1514-4c2f-a47a-5c9e2b9c24d4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.715217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.739371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 50/107] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:45.740264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.753422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.754111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.754392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.754667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.756114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:45.757718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:45.759704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 58/108] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:45.760296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.887801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf3605-63cc-4156-9a64-e29a47285fa2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.911401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de27b-9648-45ff-9908-538bd172e439 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:45.937766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.938421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.938726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.939421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.952662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:45.953500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:45.953744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:45.954087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:45.954498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:45.959285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:45.960386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:45.961262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 51/109] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:45.961940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:45.967418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:45.980906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:45.989699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:45.990714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:45.991481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:45.992094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 59/110] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:45.994337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.076667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.134299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3699-e023-455a-81ab-43b9f90436bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.145729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216755d8-6536-4242-a673-ade0db890bbd None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.170388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.171009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.171495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.171607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.182720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.183556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.183979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.184391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.185288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:46.185727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.187316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.196268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 60/111] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.197302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.262114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.264862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.268957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.318261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22833e-6b26-4116-86ca-d3799536a7e5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.320056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.357455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.358063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.358344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.358618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.359296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:46.359718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.361378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.370253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 61/112] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.375725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.396303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 52/113] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:46.397029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.486190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda33b-1ab9-4005-b41e-f8a5c95ab053 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.505511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b261-1db8-42f2-84cd-bc453ef3f042 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.508087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.522138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.523041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.523500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.523970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.536385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:46.542249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:46.543127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:46.544168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 62/114] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:46.549407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.553158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.553834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.555033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.555033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.555640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.557160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.559380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 53/115] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.560230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.580201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.674964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a7596-d727-4224-a428-9c8c6871a9f1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.695025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d941-299c-47b7-b398-3964bb7492a7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.720112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.720882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.721082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.721364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] PATH_INFO: `/v3/users/c283501180e146e19c1574f09f326f1e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.723623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] RBAC: Authorizing `identity:get_user(user_id=c283501180e146e19c1574f09f326f1e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.725489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.727765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 63/116] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/users/c283501180e146e19c1574f09f326f1e => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.728641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.742727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.744120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.744676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.745301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.746635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.748299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.750288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 54/117] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.751291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.806587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.847362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:46.858921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262befd-96b8-43db-b419-a83578b3d436 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.877531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33dd56-0c29-42cb-9ca3-4d3ec11b4c61 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:46.899668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.900414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.901148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.901528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:46.902308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:46.902717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:46.904212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:46.914416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 64/118] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:46.920916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:46.922900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:46.924209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:46.924698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:46.926036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.015073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.017438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.041527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc384efd-d95d-4e78-a6ac-436e6967fcfc None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.071736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.094136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.095398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.095938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.096512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.131706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.142732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 55/119] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:47.143802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.191455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.193671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.251888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39a06-760d-4516-8ea9-964ae9e09adb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.287309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.288089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.288663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.289048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.290083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] RBAC: Adding query filter params (role.id=97a257abeb7a4ede9a810f05489b076d, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09, user.id=25ec2169aa074182a0582fc390a13413) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:47.290345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.292628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.300729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 56/120] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/role_assignments?user.id=25ec2169aa074182a0582fc390a13413&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=97a257abeb7a4ede9a810f05489b076d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:47.301831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.306522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.333019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 65/121] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:47.334201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.396597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.441971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8be5-14b4-45ea-b61b-4c60a871485e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.490040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.490947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.491404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.493928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] PATH_INFO: `/v3/users/25ec2169aa074182a0582fc390a13413` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.497622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] RBAC: Authorizing `identity:get_user(user_id=25ec2169aa074182a0582fc390a13413)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.499329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.503771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 57/122] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/users/25ec2169aa074182a0582fc390a13413 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:47.506545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.519223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1790f1-93a9-4cd9-825d-c2200c4d8bd5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.572178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.573515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.574184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.574566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.576011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.580034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.581846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 66/123] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:47.582637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.609012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.649218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ae94d-90a0-4cb8-bad8-957dce5833f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.696126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.696802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.697092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.697377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.701217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.702711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.704656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 58/124] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:47.707383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.722062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169121d-6287-4609-ab58-c580c35a0952 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.751464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.767963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.768636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.769036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.769316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.829622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dfa31-cb65-48ef-9551-07da290fe676 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:47.858542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.860209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.877104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:47.877731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:47.878019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:47.878301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:47.879042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] RBAC: Adding query filter params (role.id=0a30341733f84c6dbebd64f0f0d6b3d6, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09, user.id=25ec2169aa074182a0582fc390a13413) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:47.879360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:47.880859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:47.887824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 59/125] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/role_assignments?user.id=25ec2169aa074182a0582fc390a13413&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=0a30341733f84c6dbebd64f0f0d6b3d6 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:47.888493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:47.892238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:47.986813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 67/126] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:47.995276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.036051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.096255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d36e4-920f-40cc-8bcb-3280c021c479 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.146713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.147329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.147635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.147874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.148645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09, user.id=c283501180e146e19c1574f09f326f1e) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:48.148955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.150409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1a64-047c-4d98-82b7-65a24c63205c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:48.151752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cebd6e-1b6e-4827-a01d-1f5e61b6d5db None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.157915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 60/127] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/role_assignments?user.id=c283501180e146e19c1574f09f326f1e&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:48.158963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb13e-32ea-4026-b6ef-af7bff0067d1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.159247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb13e-32ea-4026-b6ef-af7bff0067d1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.159527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb13e-32ea-4026-b6ef-af7bff0067d1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.169237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 61/128] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:48.175670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851fab2-8e54-40c8-96b5-cc9453a61042 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.175956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851fab2-8e54-40c8-96b5-cc9453a61042 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.176228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851fab2-8e54-40c8-96b5-cc9453a61042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.193430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.194371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.194676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.194957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] PATH_INFO: `/v3/projects/4b71cbf599324fe59d7c5d01c991e238` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.196201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] RBAC: Authorizing `identity:get_project(project_id=4b71cbf599324fe59d7c5d01c991e238)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.198556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:48.199214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9851fab2-8e54-40c8-96b5-cc9453a61042 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:48.200443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9851fab2-8e54-40c8-96b5-cc9453a61042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:48.200836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 68/129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:47 2022] GET /identity/v3/projects/4b71cbf599324fe59d7c5d01c991e238 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:48.206931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.278446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.284530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 62/130] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:07:48.286085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054025a0-81bd-4e35-bb4d-5975f7a34b8b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.286377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054025a0-81bd-4e35-bb4d-5975f7a34b8b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.286656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054025a0-81bd-4e35-bb4d-5975f7a34b8b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.288016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 63/131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:48.293968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.293968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.294203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.328123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:48.329411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:48.335738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.352385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6876d8c-ecc2-464a-9ca6-baff93acac31 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.406097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.406771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.407060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.407340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.408079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] RBAC: Adding query filter params (role.id=97a257abeb7a4ede9a810f05489b076d, scope.project.id=4b71cbf599324fe59d7c5d01c991e238, user.id=25ec2169aa074182a0582fc390a13413) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:48.408393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.411776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:48.416340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 64/132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:07:48.421029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 69/133] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:48 2022] GET /identity/v3/role_assignments?user.id=25ec2169aa074182a0582fc390a13413&scope.project.id=4b71cbf599324fe59d7c5d01c991e238&role.id=97a257abeb7a4ede9a810f05489b076d => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:48.557980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.673155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719737e-24cc-401c-b009-dd315ade9004 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.700032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.703294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.708482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.709148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.709454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.709730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.720255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:48.725129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:48.725984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:48.726746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:48.732729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.811300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beceb-733e-458b-b1d3-eb9d58eba537 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.839700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9550-55b7-4f7d-8b71-493d74661eea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.844978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.845680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.846035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.846384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.847567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.849158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:48.850718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 70/135] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:48.857045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.874023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.874633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.874917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.875197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.875847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:48.876156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.877651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:48.881331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.885903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:48.891445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:48.941221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:48.956434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1488b5-feb7-4ef5-adaa-30a50eecb36e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.989808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:48.990413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:48.990695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:48.990975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:48.991627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:48.991990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab9b71-02e2-4775-8d37-ac7db62c03f6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:48.993117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:49.015300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 71/137] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:48 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:07:49.028691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:49.028691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:49.028691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:49.028691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] PATH_INFO: `/v3/users/bcdb42eefba442338fa9795ec44fe29e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:49.029827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] RBAC: Authorizing `identity:get_user(user_id=bcdb42eefba442338fa9795ec44fe29e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:49.031318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:49.033040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 67/138] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:48 2022] GET /identity/v3/users/bcdb42eefba442338fa9795ec44fe29e => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:49.038893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:49.123910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:49.147857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13ee0-d8c0-4129-8de7-6dd561fad7c5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:49.183194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:49.183937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:49.184224 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:49.184529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:49.252543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:49.253998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:49.333819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:49.360685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:49.366560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:49.477673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6235aef-87c9-4880-9f9d-689fd9959759 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:49.497522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:49.519367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:49.519937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:49.520225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:49.521936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:49.523054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:49.524614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b29a-2966-4862-9968-565fb65b4a6a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:49.527259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 68/140] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:49 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:49.533287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:49.637913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa113b-e41f-4706-8231-9273e88e4e49 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:49.674691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:49.675307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:49.675592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:49.675870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:49.676643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] RBAC: Adding query filter params (role.id=bc7efaa1905c48e8982df8bf24a173e2, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09, user.id=bcdb42eefba442338fa9795ec44fe29e) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:49.676957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:49.678403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69eb9e-b832-4fce-b244-d948df7e564b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:49.685263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 73/141] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:49 2022] GET /identity/v3/role_assignments?user.id=bcdb42eefba442338fa9795ec44fe29e&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=bc7efaa1905c48e8982df8bf24a173e2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:51.324724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c563-8f59-486e-a261-752970ff6cf0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.325817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c563-8f59-486e-a261-752970ff6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.326307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c563-8f59-486e-a261-752970ff6cf0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.329673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 69/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:51.334061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c83ec-e3b3-4c3f-9e40-64210fec43bc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.334595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c83ec-e3b3-4c3f-9e40-64210fec43bc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.334595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c83ec-e3b3-4c3f-9e40-64210fec43bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.354923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-de1c83ec-e3b3-4c3f-9e40-64210fec43bc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:51.356410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-de1c83ec-e3b3-4c3f-9e40-64210fec43bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:51.397835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:51.433850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 74/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:51.452436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfea0-0bfe-481b-a829-74bdccfe94a2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.452754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfea0-0bfe-481b-a829-74bdccfe94a2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.453033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cfea0-0bfe-481b-a829-74bdccfe94a2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.454375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 70/144] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:51.459513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc55c8-8a3d-4f6b-ace5-d55b02e809de None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.459801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc55c8-8a3d-4f6b-ace5-d55b02e809de None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.460077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc55c8-8a3d-4f6b-ace5-d55b02e809de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.478138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-17dc55c8-8a3d-4f6b-ace5-d55b02e809de None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:51.480169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-17dc55c8-8a3d-4f6b-ace5-d55b02e809de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:51.551115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 75/145] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:51.608628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f096-bd66-4f49-b74b-faddb42a8bce None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.608843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f096-bd66-4f49-b74b-faddb42a8bce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.609294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f096-bd66-4f49-b74b-faddb42a8bce None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.610792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 71/146] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:51.616156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.616471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.616776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.636010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:51.637020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:51.701844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00f096-bd66-4f49-b74b-faddb42a8bce None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:51.706813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 76/147] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:51.812916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00f096-bd66-4f49-b74b-faddb42a8bce None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:51.817702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:51.849075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:51.850559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:51.851134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.851372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.851735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.863046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:51.868220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:51.869130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:51.873658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 72/148] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:07:51.875838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:51.927410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205a9b-a7a0-4c38-926f-3c34c52594ba None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:51.928071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:51.963827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:51.964640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:51.964921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:51.965193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:51.975745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:51.981335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:51.982178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 77/149] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:07:51.983217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:51.988033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9d8a-5f19-485d-b512-5afece71e88b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.021537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.022139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.022423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.022703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.023365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:52.023668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.025110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.034561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 73/150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.035201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.077334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.086318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852bff6-5704-4317-855c-03a00cae1f02 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.121115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.121674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.121956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.122232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.123354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.124903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.126634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.127227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.139618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41334e34-8b37-4d46-af5a-2c13003b440f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.148969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.174083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.174691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.174968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.175238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.175890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:52.176191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.177599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.186257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:07:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.187031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.233372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd7a49-386c-4288-b743-f33688d7350f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.267064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.267688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.267962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.268236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] PATH_INFO: `/v3/users/63876787fb2b41e781c4cfa18d12886d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.280924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] RBAC: Authorizing `identity:get_user(user_id=63876787fb2b41e781c4cfa18d12886d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.282363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.283940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:52 2022] GET /identity/v3/users/63876787fb2b41e781c4cfa18d12886d => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.285250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c76d3-98b0-465d-bc34-89695e36080b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.289276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.307485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.319160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.319769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.320050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.320324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.320994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.323019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.343769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 75/154] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:52 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:52.343769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.378459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.397458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48cce8-c8cd-4cc5-99f5-4a3e07f13e09 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.437628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.438279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.438559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.438834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] PATH_INFO: `/v3/users/63876787fb2b41e781c4cfa18d12886d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.440062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] RBAC: Authorizing `identity:get_user(user_id=63876787fb2b41e781c4cfa18d12886d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.441537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.443193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:52 2022] GET /identity/v3/users/63876787fb2b41e781c4cfa18d12886d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.449869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.468311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb9e32-6802-46d6-a2a9-aca606bb779d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.505984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.506945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.507393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.507670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.508909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.510561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.512366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:52 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:52.518589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.547329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.564780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096f2f-9ee5-4312-8157-373eefbc1f5f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.613706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.614344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.614678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.614955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.616591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.618034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.620657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 81/157] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:52 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:52.628219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:52.629273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:52.640480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cb698-925b-439d-a101-e1eb34865322 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.681029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.682576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.684416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.685139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/users/63876787fb2b41e781c4cfa18d12886d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.688882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, user_id=63876787fb2b41e781c4cfa18d12886d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.691996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42d20f-7599-4c43-96a9-7a59282aa4b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.709889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 77/158] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:52 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/users/63876787fb2b41e781c4cfa18d12886d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:07:52.766138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb2c1-78b5-4f43-8a80-56e06d004d8e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:52.805667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:52.806403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:52.806686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:52.807704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/users/63876787fb2b41e781c4cfa18d12886d/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:52.810605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, user_id=63876787fb2b41e781c4cfa18d12886d, role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:52.812788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff8b7-a662-40bd-9357-961fe5864873 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:52.830232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 82/159] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:52 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/users/63876787fb2b41e781c4cfa18d12886d/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:07:54.664714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5a3-6201-4bef-92ad-7f215f30f8e1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.665743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5a3-6201-4bef-92ad-7f215f30f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.666926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5a3-6201-4bef-92ad-7f215f30f8e1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.668540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 78/160] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:54.674637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47e6-7bef-49fe-b53f-670c1443c7d7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.675558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47e6-7bef-49fe-b53f-670c1443c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.676043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47e6-7bef-49fe-b53f-670c1443c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.694300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dfad47e6-7bef-49fe-b53f-670c1443c7d7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:54.695782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dfad47e6-7bef-49fe-b53f-670c1443c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:54.706016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:54.765235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 83/161] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:54.773043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def01f1-2796-4578-bbe0-347e1b23b747 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.773595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def01f1-2796-4578-bbe0-347e1b23b747 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.774100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def01f1-2796-4578-bbe0-347e1b23b747 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.776171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 79/162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:54.781787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9786b-d1c0-4be7-afcb-a80c0242775d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.782078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9786b-d1c0-4be7-afcb-a80c0242775d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.782354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9786b-d1c0-4be7-afcb-a80c0242775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.806075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-12c9786b-d1c0-4be7-afcb-a80c0242775d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:54.808107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-12c9786b-d1c0-4be7-afcb-a80c0242775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:54.879656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:54.936848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245455e-b6ad-40c3-8ff8-71d89b835577 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.937452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245455e-b6ad-40c3-8ff8-71d89b835577 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.937948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245455e-b6ad-40c3-8ff8-71d89b835577 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.939505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 80/164] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:54.944976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1e0d7-9139-44d4-b074-7b9654214a6e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:54.945514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1e0d7-9139-44d4-b074-7b9654214a6e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:54.945979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1e0d7-9139-44d4-b074-7b9654214a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:54.966110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-74a1e0d7-9139-44d4-b074-7b9654214a6e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:54.967795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-74a1e0d7-9139-44d4-b074-7b9654214a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:55.038267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:55.052912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245455e-b6ad-40c3-8ff8-71d89b835577 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.109856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81899-0e1f-4a5f-95fe-ef3f90395ed3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.110395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81899-0e1f-4a5f-95fe-ef3f90395ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.110828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea81899-0e1f-4a5f-95fe-ef3f90395ed3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.112300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 86/166] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:55.117634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.118192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.118728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.129344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.143409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:55.144978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:55.170485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245455e-b6ad-40c3-8ff8-71d89b835577 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.210423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.210975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.211245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.211665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.218801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 87/167] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:55.219917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.234274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:55.241983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:55.242820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:55.243663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:55.245882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 81/168] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:55.251581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.270717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.354481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4f99d-525d-4511-bf70-0911c564ffec None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.361389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20300-34f9-460b-8c6b-46c9c8e7bd3c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.393629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.394266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.394547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.394821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.395931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.397416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.398983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:55.399094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.399746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.402444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.404298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.404616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.404891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.405564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:55.405873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.407259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.415736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:55.420713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.497083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.512683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ebac1-040f-4003-81d2-a92c943ca93f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.519518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45bc5f-cd9c-4691-8238-59e0a77be9b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.547229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.547870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.548153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.548742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.553563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.554164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.554441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.554712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.555357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.556959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.558516 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:55.563339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:55.564207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:55.565004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:55.567183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.578725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 83/172] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:55 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:55.579809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.638400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.689494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46a77b-941e-4b3a-b5db-9cc99118852c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.708586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925224e3-5805-4082-a927-87fdaf439d69 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.729172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.729822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.730100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.730371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] PATH_INFO: `/v3/users/812854e07e6d48518da72c57b971da00` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.746629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.749096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=812854e07e6d48518da72c57b971da00)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.751365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.753020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.754182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/users/812854e07e6d48518da72c57b971da00 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:55.754293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.754293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.754533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.754939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.767581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:55.773132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:55.773982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:07:55.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 84/174] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:55.776100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.883890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd45c0d-a0dd-4410-b287-fa7946809bd9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.898769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2aa59-9f99-4afd-b380-70e45639a427 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:55.911482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:55.937842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.938593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.938958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.939330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.940006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:55.940305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.941718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.944090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:55.945022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:55.945453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:55.945863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:55.947226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:55.949093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:55.950896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 85/175] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:55.951700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 91/176] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:55.951976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:55.961459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.034359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.080172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b9ac-afa7-4c34-b98c-074760a69e6a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.083935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072db5-6ef7-40fd-96fc-a33766f61626 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.122555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.123248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.123589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.123930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.124809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:56.125162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.126605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.126894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.127744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.128486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.128953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/users/812854e07e6d48518da72c57b971da00/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.131554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, user_id=812854e07e6d48518da72c57b971da00, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.134040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.136829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 86/177] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:07:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:56.141354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.154330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 92/178] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:55 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/users/812854e07e6d48518da72c57b971da00/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:07:56.160354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.213052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.314458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2a3d-8f4e-4670-92fb-fbb5a286d307 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.362898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af815fb-107c-44bf-8023-105cb9ea40c8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.398026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.398681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.398962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.399233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] PATH_INFO: `/v3/users/63876787fb2b41e781c4cfa18d12886d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.401507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] RBAC: Authorizing `identity:get_user(user_id=63876787fb2b41e781c4cfa18d12886d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.403339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.405194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 93/179] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/users/63876787fb2b41e781c4cfa18d12886d => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:56.409032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.412073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.427248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.428347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.428915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.429411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] PATH_INFO: `/v3/users/63876787fb2b41e781c4cfa18d12886d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.430973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] RBAC: Authorizing `identity:get_user(user_id=63876787fb2b41e781c4cfa18d12886d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.434096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.436329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 87/180] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/users/63876787fb2b41e781c4cfa18d12886d => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:56.445502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.533361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927c51-125e-4f2b-8006-b75b044a5839 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.545509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.599130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.599714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.599998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.600276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.662412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232bf95-5b24-43df-854d-f935086f8cfe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.687847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.689347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.741182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.741853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.742092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.742366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.801712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 94/181] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 19:07:56.807407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:56.819874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.883042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:56.914518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.916650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.924489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49482157-42e1-493b-951c-a66d32c8a24f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:56.969343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:56.969980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:56.970261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:56.970536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:56.971688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:56.973767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:56.975737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 95/182] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:56.983645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:57.050639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:07:57.057400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:57.153846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:57.185780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:57.196485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094538f-1a1f-4ff5-88e9-8ac12988c4e3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:57.222372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd106d-035c-4f13-b31c-4fc4a3fe11ed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:57.245668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:57.246313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:57.246592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:57.246866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:57.248107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:57.250740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:57.252500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 89/184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:57 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:57.259469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:57.283217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:57.283833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:57.284110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:57.284380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:57.285143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] RBAC: Adding query filter params (role.id=0a30341733f84c6dbebd64f0f0d6b3d6, scope.project.id=7fc723822bf54fb1990898adff45938d, user.id=63876787fb2b41e781c4cfa18d12886d) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:57.285448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:57.286878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afa1b9-4e21-4935-a8b9-3c9fe7210170 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:57.299160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 96/185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:56 2022] GET /identity/v3/role_assignments?user.id=63876787fb2b41e781c4cfa18d12886d&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=0a30341733f84c6dbebd64f0f0d6b3d6 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:57.390194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0395bc-bc16-4227-9065-56454c0c0441 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:57.434426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:57.434957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:57.435238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:57.435510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:57.436240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=7fc723822bf54fb1990898adff45938d, user.id=63876787fb2b41e781c4cfa18d12886d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:57.436569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:57.438010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75c30-21c2-4683-80c0-520ae83266a1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:57.450496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 90/186] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:07:57 2022] GET /identity/v3/role_assignments?user.id=63876787fb2b41e781c4cfa18d12886d&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:58.098964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8266b1-4d03-4fa0-905c-1e383738ef98 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.099527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8266b1-4d03-4fa0-905c-1e383738ef98 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.099527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8266b1-4d03-4fa0-905c-1e383738ef98 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.100931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 97/187] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:58.106306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.107118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.107605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.128968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:58.130455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:58.142730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137040-ed2d-46e4-827f-51daec09892a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.143287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137040-ed2d-46e4-827f-51daec09892a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.143794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137040-ed2d-46e4-827f-51daec09892a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.145326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 98/188] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:07:58.150171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:58.152219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.152531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.152858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.174895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:58.176108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:58.208071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 91/189] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:58.245962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 99/190] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:07:58.481519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:58.516514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:58.589421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628292-f021-434d-ae55-09a35e4a0af1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:58.597329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:58.631906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f1d2-a585-4235-9cb9-5d6c7822a24e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:58.635464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:58.635464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.635761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.635973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.637158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:58.638635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:58.640497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 92/191] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:07:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:58.646008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:58.672568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:58.675638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:58.676384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.676612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.676857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.687672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:58.693843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:58.694707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:58.695478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:58.702845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:58.756526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a82de-4be0-46c7-b6e1-9bc935a933f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:58.790239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:58.791422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.791700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.792111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.792794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:58.794234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775296bf-8ed1-435d-9020-061d2d8e442f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:58.810113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fc881-035f-4b7d-9c32-17e05d407ea9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:58.815167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 93/193] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:07:58 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:07:58.816428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1951-9abb-48c0-a242-c4b80f4a792b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.816748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1951-9abb-48c0-a242-c4b80f4a792b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.817021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1951-9abb-48c0-a242-c4b80f4a792b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.818239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 94/194] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:07:58.830622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.830978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.831180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.848423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:58.852475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:07:58.853798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:07:58.855269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:58.856113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:58.856626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:58.857195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:58.857895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:58.858200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:58.859615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:58.870599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 101/195] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:58.876410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:58.933912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 95/196] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:07:58.998424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75010-9169-4dc9-a204-19dcfdd8490d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.033162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.033718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.033998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.034271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] PATH_INFO: `/v3/users/63d5ab4a440b45fc9b931ec13af19d2d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.048942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] RBAC: Authorizing `identity:get_user(user_id=63d5ab4a440b45fc9b931ec13af19d2d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:59.050404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:59.052072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 102/197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:58 2022] GET /identity/v3/users/63d5ab4a440b45fc9b931ec13af19d2d => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:07:59.059162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.069227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:59.171841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df455c7a-c8aa-450c-8d48-bdba168729a0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.208925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.209567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.209845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.210121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.211248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:59.213988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.214434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:59.215907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 96/198] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:07:59 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:59.221700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.290373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:59.313849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:59.346295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7f0c6-62d9-486b-971e-46117dc3110c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.348154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a337272-8ed5-425b-8d57-c1cd14f8e02c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.389456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.390184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.390538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.390823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.391104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.391298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.391401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.391793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/users/63d5ab4a440b45fc9b931ec13af19d2d/roles/bc7efaa1905c48e8982df8bf24a173e2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.394129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, user_id=63d5ab4a440b45fc9b931ec13af19d2d, role_id=bc7efaa1905c48e8982df8bf24a173e2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:59.395754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:59.403777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:07:59.410287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:07:59.411233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:07:59.412006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 103/199] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:07:59.417336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 97/200] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:07:59 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/users/63d5ab4a440b45fc9b931ec13af19d2d/roles/bc7efaa1905c48e8982df8bf24a173e2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:07:59.421854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.547230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc813f-6295-480a-9a16-39adcf215c17 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.564283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:07:59.590015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.590804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.591183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.591566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.592374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:07:59.592807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:59.594314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:59.604789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 104/201] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:07:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:59.610715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.718697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8867b5-e378-4363-9381-0be9ac9764b3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.755899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.756568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.756852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.757130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] PATH_INFO: `/v3/users/812854e07e6d48518da72c57b971da00` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.758341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=812854e07e6d48518da72c57b971da00)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:07:59.760361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:07:59.762246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 98/202] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:07:59 2022] GET /identity/v3/users/812854e07e6d48518da72c57b971da00 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:07:59.767844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:07:59.885320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772276-b957-4afa-a6bd-baaa77272ee1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:07:59.921811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:07:59.922788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:07:59.923601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:07:59.924087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:07:59.979776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:00.006518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:00.007985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:00.110208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:00.115997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:00.119430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:00.224783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ad6cf-ae36-4394-bde8-dbacf89f8aa0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:00.269241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:00.269889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:00.270172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:00.270450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:00.271580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:00.273085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843d48d-834a-4379-b33a-93d441bcd0d0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:00.274738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 99/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:00 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:00.281784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:00.361549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:00.392584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8d21-3f8b-47b9-bf36-0c94e3a2e788 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:00.430726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:00.431412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:00.431697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:00.432148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:00.432992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] RBAC: Adding query filter params (role.id=97a257abeb7a4ede9a810f05489b076d, scope.project.id=7fc723822bf54fb1990898adff45938d, user.id=812854e07e6d48518da72c57b971da00) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:00.433307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:00.434749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca5dd4-2a69-4b5b-975e-76db9c950e7c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:00.440985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 106/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:00 2022] GET /identity/v3/role_assignments?user.id=812854e07e6d48518da72c57b971da00&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=97a257abeb7a4ede9a810f05489b076d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:01.255070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eedc4-a175-466f-ac6e-82fbd2cf146c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.255579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eedc4-a175-466f-ac6e-82fbd2cf146c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.255579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eedc4-a175-466f-ac6e-82fbd2cf146c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.257129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 100/206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:01.260882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836261c-73fe-4ab3-bb1d-3371166234fe None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.261240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836261c-73fe-4ab3-bb1d-3371166234fe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.261820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836261c-73fe-4ab3-bb1d-3371166234fe None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.262755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.263047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.263394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 107/207] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:01.263494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.268297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.268617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.268896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.281733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:01.282912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:01.287128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:01.288278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:01.349406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:01.362110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 108/208] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:01.362273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 101/209] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:01.620712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:01.629519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:01.693861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:01.727792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3635de-2b69-4d60-b98d-163300d2b82c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:01.739727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631689e4-e85f-4ffb-bc59-49eee3b31f92 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:01.764802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:01.765437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.765719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.766013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.776845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:01.780085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:01.780746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.781027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.781301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-2ffa10a6-2374-4953-b2f5-ff6112d4604f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:01.781671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:01.782578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:01.783358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:01.784089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:01.784168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 109/210] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:01.784168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e481f-2ad3-419d-95c0-b42f42d249af None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.784168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e481f-2ad3-419d-95c0-b42f42d249af None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.784497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e481f-2ad3-419d-95c0-b42f42d249af None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.786196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 110/211] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:01.789436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ecda-9e86-41f1-bbd3-ecc5933095ca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:01.794534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 102/212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:01.794686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e481f-2ad3-419d-95c0-b42f42d249af None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:01.794763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.794763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.794763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.810998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:01.812173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:01.874501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:01.880086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 103/213] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:01.880898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:01.894973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e481f-2ad3-419d-95c0-b42f42d249af None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:01.922654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:01.932101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:01.932826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:01.933174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:01.933522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:01.934273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:01.934577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:01.935960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:01.944412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 111/214] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:01.951349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:01.983418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8d72-26c6-4c27-9c31-ef0704f2c627 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.017522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.018369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.018826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.019268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.020104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.021754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:02.045168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 104/215] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:01 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:02.061080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b34968-f4a4-416e-873a-287504483d91 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.099096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.099747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.100019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.100341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] PATH_INFO: `/v3/users/4c17ae463c22422080d417729dad4b2e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.116399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] RBAC: Authorizing `identity:get_user(user_id=4c17ae463c22422080d417729dad4b2e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.117919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:02.120654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 112/216] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:01 2022] GET /identity/v3/users/4c17ae463c22422080d417729dad4b2e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:02.126461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:02.151204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:02.188169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:02.211011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:02.243331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867311c3-ea38-4cdf-94b5-cb7bcaed7aea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.274408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb0e7-85d7-4273-a17f-8685f87fbec0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.284161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.284962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.285246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.285517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.286238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] RBAC: Adding query filter params (role.id=97a257abeb7a4ede9a810f05489b076d, user.id=4c17ae463c22422080d417729dad4b2e, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:02.286542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.287976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:02.295133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 105/217] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 19:08:02 2022] GET /identity/v3/role_assignments?user.id=4c17ae463c22422080d417729dad4b2e&scope.system=all&role.id=97a257abeb7a4ede9a810f05489b076d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:02.312662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.313321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.313601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.313879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.328606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:02.333673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:02.334782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:02.335696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 113/218] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:02.341716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:02.467145 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8e54-4dd3-47a4-a6f8-78b639757f4f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.489236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:02.504732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.505353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.505696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.505976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.506714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:02.507014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.508526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:02.517561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 106/219] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:02.523141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:02.632541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea9ee-e48a-4910-8d34-7731fa768305 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.642508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:02.672284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.674313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.674596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.674876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] PATH_INFO: `/v3/users/63d5ab4a440b45fc9b931ec13af19d2d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.676141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=63d5ab4a440b45fc9b931ec13af19d2d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.677636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:02.679350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 114/220] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:02 2022] GET /identity/v3/users/63d5ab4a440b45fc9b931ec13af19d2d => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:02.685567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:02.802241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d918-9719-4a26-87b8-8d189d9b012b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:02.841319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:02.841939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:02.842217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:02.842492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:02.893354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:02.914768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:02.916828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:03.027807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 107/221] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 19:08:03.033344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:03.140005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c3ad7-3953-48ac-bff0-008889a0d8d4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:03.179049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:03.179685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:03.179965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:03.180240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:03.182037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:03.183600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b49137-86b8-4fb7-8ff3-1732f036edb2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:03.185541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 115/222] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:03 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:03.191405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:03.282747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:03.303631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeee97-b691-406e-8d9f-a83ca387cddd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:03.339747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:03.340353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:03.340665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:03.340943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:03.341664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] RBAC: Adding query filter params (role.id=bc7efaa1905c48e8982df8bf24a173e2, scope.project.id=7fc723822bf54fb1990898adff45938d, user.id=63d5ab4a440b45fc9b931ec13af19d2d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:03.341972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:03.343414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d453-80ca-4d63-b6d3-a3480bf533a7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:03.349281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 108/223] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:03 2022] GET /identity/v3/role_assignments?user.id=63d5ab4a440b45fc9b931ec13af19d2d&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=bc7efaa1905c48e8982df8bf24a173e2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:04.450018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4c2-055d-4b9f-a7fd-4b6031d873bf None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.450596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4c2-055d-4b9f-a7fd-4b6031d873bf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.450596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e4c2-055d-4b9f-a7fd-4b6031d873bf None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.452107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 116/224] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:04.457763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4958-e237-4994-88c0-2c5b11bfb8af None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.458256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4958-e237-4994-88c0-2c5b11bfb8af None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.458356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd4958-e237-4994-88c0-2c5b11bfb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.476716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62cd4958-e237-4994-88c0-2c5b11bfb8af None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:04.478437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62cd4958-e237-4994-88c0-2c5b11bfb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:04.483688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cb6e1-16fb-4625-a92f-33722057ee9f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.483980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cb6e1-16fb-4625-a92f-33722057ee9f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.484248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cb6e1-16fb-4625-a92f-33722057ee9f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.485748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 117/225] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:04.490656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.490942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.491216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.511407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:04.512599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:04.549292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 109/226] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:04.554273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192019-32ba-4a33-a5c4-15f387331a58 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.554397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:04.554489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192019-32ba-4a33-a5c4-15f387331a58 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.554595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49192019-32ba-4a33-a5c4-15f387331a58 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.556354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 110/227] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:04.561432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.561719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.561993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.580599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:04.581778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:04.584507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 118/228] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:04.654739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 111/229] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:04.821737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:04.857401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:04.860892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:04.930307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0991-7f74-48d0-9e98-f85613d4a298 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:04.964567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cb531-8bf7-4c8e-9425-a68521979d6b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:04.965648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:04.966292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:04.966573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:04.966857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:04.976803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:04.982155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:04.983028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 119/230] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:04.984059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:04.999953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.000623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.001001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.001277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.002361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.003799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.005387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 112/231] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:05.005387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.022517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.074917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.088393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea428b-5563-4d1a-83ac-9b4257127ab6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.106945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fc7d0-5738-487e-9062-652f3f568b89 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.121051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.121676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.121951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.122226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.131987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:05.137334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:05.138395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 120/232] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:05.141545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.146887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.147493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.147771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.148053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.148746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:05.149045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.150965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.159289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 113/233] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:05.160245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.231488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.239278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd13c5-2a82-49ff-b899-a391797c2e2b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.262569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4bc07-d7ea-404e-add7-b6ecfb1e3696 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.274635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.275243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.275523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.275801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] PATH_INFO: `/v3/groups` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.276436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.277906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.293943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 121/234] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 31 19:08:05 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:05.293943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.304803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.304803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.304803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.304803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.305093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:05.305093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.305093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.305093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.312706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 114/235] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:05.319375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.443426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504450-f5a9-4401-97c4-6416d7061d27 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.443751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae27855-302c-4f04-aece-eed0db29b50e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.483880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.483880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.484534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.484880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.484880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] PATH_INFO: `/v3/users/43d541ddb5e341bb917c1e7292fb377a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.485015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.485119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.485390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] PATH_INFO: `/v3/users/4c17ae463c22422080d417729dad4b2e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.486515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] RBAC: Authorizing `identity:get_user(user_id=4c17ae463c22422080d417729dad4b2e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.487969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.489780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 115/236] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:05 2022] GET /identity/v3/users/4c17ae463c22422080d417729dad4b2e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:05.495762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.502261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] RBAC: Authorizing `identity:get_user(user_id=43d541ddb5e341bb917c1e7292fb377a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.503742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.505544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 122/237] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:05 2022] GET /identity/v3/users/43d541ddb5e341bb917c1e7292fb377a => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:05.511408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:05.528362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.563410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:05.604224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0e9aa-307c-4ebb-b79b-ac057b86c9ac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.621972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead0963-56fc-4068-9ceb-64e0a4c11de0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:05.638443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.639098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.639382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.639654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] PATH_INFO: `/v3/system/users/4c17ae463c22422080d417729dad4b2e/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.641061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4c17ae463c22422080d417729dad4b2e, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.642433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982eca5-c10a-41ce-ac68-9f2c2f56a4a7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.651617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 116/238] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 31 19:08:05 2022] PUT /identity/v3/system/users/4c17ae463c22422080d417729dad4b2e/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:08:05.657590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:05.658235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:05.658495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:05.658779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:05.659520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] RBAC: Adding query filter params (role.id=bc7efaa1905c48e8982df8bf24a173e2, user.id=43d541ddb5e341bb917c1e7292fb377a, scope.system=all) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:05.659826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:05.661377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc112fcb-e21f-43a6-8f1f-b90f932bb163 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:05.668159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 123/239] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 19:08:05 2022] GET /identity/v3/role_assignments?user.id=43d541ddb5e341bb917c1e7292fb377a&scope.system=all&role.id=bc7efaa1905c48e8982df8bf24a173e2 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:07.500090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dce40-a059-4efc-b0f5-7787902747fa None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.500634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dce40-a059-4efc-b0f5-7787902747fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.500707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dce40-a059-4efc-b0f5-7787902747fa None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.502055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 117/240] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:07.507246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fb06-f371-4ae0-b4de-ae73db807742 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.507636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fb06-f371-4ae0-b4de-ae73db807742 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.507789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fb06-f371-4ae0-b4de-ae73db807742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.526111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c321fb06-f371-4ae0-b4de-ae73db807742 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:07.527280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c321fb06-f371-4ae0-b4de-ae73db807742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:07.593708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:07.817275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f760-3f9b-4245-8452-d0cba8ceeeb6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.817556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f760-3f9b-4245-8452-d0cba8ceeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.818001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f760-3f9b-4245-8452-d0cba8ceeeb6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.819355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 118/242] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:07.824895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.825190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.825468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.838309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:07.840129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd53ab0-f2c3-459f-9b8e-87bd34ce47bf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.840414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd53ab0-f2c3-459f-9b8e-87bd34ce47bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.840714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd53ab0-f2c3-459f-9b8e-87bd34ce47bf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.842204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 119/243] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:07.845537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:07.846736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:07.847584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:07.847868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:07.848143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:07.869664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:07.870983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:07.913503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 125/244] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:07.914743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:07.944204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:08.015779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bbe7-bb09-440c-a0b9-f13259e46461 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.049523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.050068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.050343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.050614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.051697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.053162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.055142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 126/246] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:08.061393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.120009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.163476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfed092-3106-47b5-b4c2-3a63e6193232 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.181729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.185817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.201123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.201832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.202126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.202403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.203048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.204527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.222249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 121/247] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 31 19:08:08 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:08.223305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.298116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2414c-4a0d-4477-94b6-728123cb2b16 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.330166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f8a7-9689-4b87-86bd-93b1fec24e9b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.338525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.339458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.339740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.340011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.350123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.352181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:08.357337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:08.358262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:08.359844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 127/248] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:08.364330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.374956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.375744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.376018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.376299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.389016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:08.394889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:08.396028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:08.397068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 122/249] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:08.402413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.448343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.495272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d780-44de-41e4-98af-0693a177a129 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.522594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c4b8-71ae-4a84-8f5b-ea5ece10f74d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.540897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.541790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.542130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.542461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.543470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:08.544227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.546383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.556609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 128/250] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:08.562457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.570368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.570986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.571962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.572238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.573805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:08.574557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.575622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.585532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 123/251] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:08.591835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.643301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.680755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ea50f-0b0e-4f3b-8a51-bae418dc4b6d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.717742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.728743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.729533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.729908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.730275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] PATH_INFO: `/v3/users/4c17ae463c22422080d417729dad4b2e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.731510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4c17ae463c22422080d417729dad4b2e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.733180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.735058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 129/252] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/users/4c17ae463c22422080d417729dad4b2e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:08.738361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf8ed-7975-4cf5-a866-7b7d00271737 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.741745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.783606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.784549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.784839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.785116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] PATH_INFO: `/v3/users/43d541ddb5e341bb917c1e7292fb377a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.787796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] RBAC: Authorizing `identity:get_user(user_id=43d541ddb5e341bb917c1e7292fb377a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.787796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.789364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 124/253] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/users/43d541ddb5e341bb917c1e7292fb377a => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:08.796651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:08.875212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d03ae-19eb-48fc-849b-a3f3951ca3b9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.920024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.920670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.920942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.921230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.921948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] RBAC: Adding query filter params (role.id=97a257abeb7a4ede9a810f05489b076d, user.id=4c17ae463c22422080d417729dad4b2e, scope.system=all) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:08.922255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.923946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38b80-4de7-457d-b2a7-522a9a96dbc7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:08.932537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfdc7-f631-493e-a666-e4ecccfc7809 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:08.939558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 130/254] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 19:08:08 2022] GET /identity/v3/role_assignments?user.id=4c17ae463c22422080d417729dad4b2e&scope.system=all&role.id=97a257abeb7a4ede9a810f05489b076d => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:08.957846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:08.994585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:08.995269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:08.995550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:08.995826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] PATH_INFO: `/v3/system/users/43d541ddb5e341bb917c1e7292fb377a/roles/bc7efaa1905c48e8982df8bf24a173e2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:08.998075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=43d541ddb5e341bb917c1e7292fb377a, role_id=bc7efaa1905c48e8982df8bf24a173e2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:08.999618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049fff1-fae9-4e24-876c-2220e3aca11d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:09.014056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 125/255] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 31 19:08:08 2022] PUT /identity/v3/system/users/43d541ddb5e341bb917c1e7292fb377a/roles/bc7efaa1905c48e8982df8bf24a173e2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:08:10.784040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a30b-0b14-4165-83f2-812190fcd91d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:10.784451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a30b-0b14-4165-83f2-812190fcd91d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:10.784681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454a30b-0b14-4165-83f2-812190fcd91d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:10.787744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 131/256] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:10.791874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:10.792306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:10.792496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:10.814080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:10.815276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:10.876615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 126/257] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 19:08:11.195207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454a30b-0b14-4165-83f2-812190fcd91d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:11.210461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454a30b-0b14-4165-83f2-812190fcd91d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:11.216525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:11.217169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.217448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.217722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.241387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:11.246620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:11.247452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:11.248240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 132/258] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:11.253772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:11.266823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f206-4a98-4f6e-88c7-54549cea4898 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:11.279920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:11.280572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.280855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.281130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.281807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:11.282107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:11.283915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:11.283915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:08:11.283915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:08:11.284854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:11.300488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 127/259] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:11.306781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:11.321820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445e1d-e31d-4d5d-8833-2b09f618fd3d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:11.332426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:11.333160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.333444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.333720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.345055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:11.346901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:11.346901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:08:11.346901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:08:11.348181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:11.350205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 133/260] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 19:08:11 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:11.355920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:11.366056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0683-5832-4ebe-8a79-0532dae75ae6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:11.375155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:11.375800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.376083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.376354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.378197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:11.380298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964c5ac-b5f0-4b6c-a526-8dcbde74a8e1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:11.382050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 128/261] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:08:11 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:11.388280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:11.402373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d605-c171-4f53-bbea-e88224768242 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:11.409167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:11.409900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.410179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.410458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/groups/91eb5366145041188486c1bd0575e4c0/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.412347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, group_id=91eb5366145041188486c1bd0575e4c0, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:11.413396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:11.413396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:08:11.413396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:08:11.415623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383b99e-20f4-4f5d-8bf9-972e7e9cf736 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:11.439585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 134/262] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 19:08:11 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/groups/91eb5366145041188486c1bd0575e4c0/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:11.675574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eec7-6947-4ce7-9a2d-2f5940b0130b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.675844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eec7-6947-4ce7-9a2d-2f5940b0130b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.676120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eec7-6947-4ce7-9a2d-2f5940b0130b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.677501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 129/263] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:11.682903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43c510-261b-45f5-8250-ac3c26c2ea2c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.683187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43c510-261b-45f5-8250-ac3c26c2ea2c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.683460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43c510-261b-45f5-8250-ac3c26c2ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.709325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cb43c510-261b-45f5-8250-ac3c26c2ea2c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:11.710525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cb43c510-261b-45f5-8250-ac3c26c2ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:11.736931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:11.791965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 135/264] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 19:08:11.858525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457f8f2-933f-4b5b-af32-d1e525cca32d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.859061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457f8f2-933f-4b5b-af32-d1e525cca32d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.859061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457f8f2-933f-4b5b-af32-d1e525cca32d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.860525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 130/265] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:11.874336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:11.874630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:11.874908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:11.896883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:11.898078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:11.910903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 136/266] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 19:08:12.215188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457f8f2-933f-4b5b-af32-d1e525cca32d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.233155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457f8f2-933f-4b5b-af32-d1e525cca32d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.237712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.238354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.238633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.238910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.252831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5894d3c8-fcb4-4544-9d06-4f8387b66d9e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:12.258375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:12.259492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:12.260261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 131/267] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:12.265679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.276259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b56b-ecff-41d0-a102-3d23682d998c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.282389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da77a-5d28-443a-bab5-c99a68e6b7d9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.282389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da77a-5d28-443a-bab5-c99a68e6b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.282389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528da77a-5d28-443a-bab5-c99a68e6b7d9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.282389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 132/268] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:12.289120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.290232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.290708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.291170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.292044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:12.292655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.293858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:12.293858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:08:12.293858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:08:12.295092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.306681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:12.308294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.308606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.308882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.320098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.340121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:12.342553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395926-516c-46aa-91c9-8017b2aafa54 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.344139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:12.350809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.351454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.351733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.352005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.355162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.359843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.361636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 138/270] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:12.367649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.380067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce41969-56a2-4cbf-b142-c56fb0c8259b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.388633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.389545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.390017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.390542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.394045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.396493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.398342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 139/271] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:12.405000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.421488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47094b1-97ed-4795-81d8-80ddac5ccce5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.434314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.435157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.435530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.435903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/groups/91eb5366145041188486c1bd0575e4c0/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.441883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, group_id=91eb5366145041188486c1bd0575e4c0, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.444752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.445650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 133/272] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:12.447264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.459890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed8ca1-e0fc-4369-aca5-4353c9c6dda6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.465990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 140/273] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 19:08:12 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/groups/91eb5366145041188486c1bd0575e4c0/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:08:12.486811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:12.542783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.543725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.544164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.544648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.559850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:12.565690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:12.566840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:12.567829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:12.574267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 134/274] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:12.582028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.600050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762735-69e1-46b0-9325-f75c6d82fef1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.610336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.611097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.611475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.611844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.612679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:12.613122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.614934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.632683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 141/275] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:12.638970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.653389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a369-d279-4a82-b0e9-1c864d1062de admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.658400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.659307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.659730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.660193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.661534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.662776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:12.662776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:08:12.662776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:08:12.664351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.669216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 135/276] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:12.675206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.690139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11ec4-cafd-404c-a6aa-86e7932a5dba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.700828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.701493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.701770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.702040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.709561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.712495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.714389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 142/277] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:12.720291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:12.735639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8363448-406b-48a5-a13b-e53013f7cb0b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:12.740837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:12.741904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:12.742384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:12.743498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/groups/91eb5366145041188486c1bd0575e4c0/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:12.746254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2457350eb2c41e3a878c7f43b10bc09, group_id=91eb5366145041188486c1bd0575e4c0, role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:12.747546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:08:12.747546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:08:12.747546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:08:12.754299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:12.780222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 136/278] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 19:08:12 2022] PUT /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09/groups/91eb5366145041188486c1bd0575e4c0/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:12.882038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.001864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e71d65-cbc7-4fda-b169-ab7d41441f74 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.022246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:13.043222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.043867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.044147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.044419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.058173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-72593c4b-8f12-4584-a103-0d1f9fff1745 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:13.063080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:13.063914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:13.064787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 143/279] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:13.071515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.111639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0058e-33ba-4849-8030-1a98bc788a17 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.111964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0058e-33ba-4849-8030-1a98bc788a17 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.112179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0058e-33ba-4849-8030-1a98bc788a17 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.114106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 144/280] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:13.120296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.120597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.120869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.153640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:13.154866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:13.229960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 145/281] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 19:08:13.241473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1087bd9-8c2b-4439-8725-0b722540eacb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.290151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.290825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.291101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.291372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.292043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:13.292345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.294128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.303644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 137/282] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.309738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.424670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52400d0a-d751-44f2-8c6c-e85f77b033c6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.450736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:13.462943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.463584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.463860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.464128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] PATH_INFO: `/v3/users/43d541ddb5e341bb917c1e7292fb377a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.465307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] RBAC: Authorizing `identity:get_user(user_id=43d541ddb5e341bb917c1e7292fb377a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.466766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b874ad-62cc-4d05-b4d2-da15e0527c29 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.468364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 146/283] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/users/43d541ddb5e341bb917c1e7292fb377a => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.474322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.492442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:13.541013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353693-a62c-49f9-9241-c6e32ff4d292 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.541200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353693-a62c-49f9-9241-c6e32ff4d292 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.541476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353693-a62c-49f9-9241-c6e32ff4d292 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.543087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 147/284] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:13.549680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.549974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.550250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.573469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:13.574663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:13.583874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 148/285] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 19:08:13.624771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305d3f-5719-4ac6-8e83-db678324ad75 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.641935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.660926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4b592-ca86-4542-90de-2ed10700aa72 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.669708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.671629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.672294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.673655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.688516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.689473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.690165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.691311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.692249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] RBAC: Adding query filter params (role.id=bc7efaa1905c48e8982df8bf24a173e2, user.id=43d541ddb5e341bb917c1e7292fb377a, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:13.692979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.696830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.699387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:13.704893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:13.705750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:13.706521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:13.709255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 149/286] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:13.718954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 138/287] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/role_assignments?user.id=43d541ddb5e341bb917c1e7292fb377a&scope.system=all&role.id=bc7efaa1905c48e8982df8bf24a173e2 => generated 510 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.730150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.742186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6110-f25f-42fa-81a7-232be7fa294d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.748092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.749152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.749633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.750123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.751122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:13.751664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.753628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.767822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 150/288] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.773318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.794335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a18-1261-4da3-a278-53b981b21808 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.805813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.806657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.806943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.807218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.808445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.810425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.812215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 139/289] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.817755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.832934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82525-348b-4aaa-be07-15c498024a48 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.841289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.842385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.842867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.843386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.849397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.852000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.854513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 151/290] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:08:13 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:13.860068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:13.873721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126dfd-9bf1-450a-9ecf-f986922ab6af admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:13.884914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:13.885605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:13.885882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:13.886160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d/groups/91eb5366145041188486c1bd0575e4c0/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:13.890191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc723822bf54fb1990898adff45938d, group_id=91eb5366145041188486c1bd0575e4c0, role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:13.892925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:13.914330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 140/291] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 19:08:13 2022] PUT /identity/v3/projects/7fc723822bf54fb1990898adff45938d/groups/91eb5366145041188486c1bd0575e4c0/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:14.177592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:14.192191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cb897-9b50-4787-9f0d-2ee437a5e854 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:14.256264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:14.257290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:14.257769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:14.258236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:14.271393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:14.277270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:14.278167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:14.278974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:14.281644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 152/292] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:14.287109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:14.299277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2475-8eef-4d40-830f-96e9a660c5c6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:14.304366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:14.306013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:14.306498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:14.306970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:14.307917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:14.308615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:14.310579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:14.321729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 141/293] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:14.327292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:14.340484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c4ae-c91d-436e-8ac4-1ec4a27eb84a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:14.345398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:14.346329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:14.346843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:14.347325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] PATH_INFO: `/v3/groups/e6fc7cd1f8c54bea9922cc2d7328b003` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:14.353159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] RBAC: Authorizing `identity:get_group(group_id=e6fc7cd1f8c54bea9922cc2d7328b003)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:14.355466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:14.357496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 153/294] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 31 19:08:14 2022] GET /identity/v3/groups/e6fc7cd1f8c54bea9922cc2d7328b003 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:14.363118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:14.375537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5f329-1585-43d0-bf73-d43b97478a78 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:14.380756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:14.381775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:14.382259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:14.382730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] PATH_INFO: `/v3/projects/aefddd72ecfc4b63a01173e7a0408933` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:14.384225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] RBAC: Authorizing `identity:get_project(project_id=aefddd72ecfc4b63a01173e7a0408933)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:14.386434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8af4-ba75-4d5e-8f59-fc3e1a0c1970 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:14.388489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 142/295] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 31 19:08:14 2022] GET /identity/v3/projects/aefddd72ecfc4b63a01173e7a0408933 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:14.394293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:14.405930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3119-08c5-497b-8be7-b4528a5ad613 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:14.411376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:14.412323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:14.412891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:14.413394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] PATH_INFO: `/v3/projects/aefddd72ecfc4b63a01173e7a0408933/groups/e6fc7cd1f8c54bea9922cc2d7328b003/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:14.416597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefddd72ecfc4b63a01173e7a0408933, group_id=e6fc7cd1f8c54bea9922cc2d7328b003, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:14.420128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700aa22-0bdb-48ff-bc50-435d226d4a79 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:14.438335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 154/296] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 31 19:08:14 2022] PUT /identity/v3/projects/aefddd72ecfc4b63a01173e7a0408933/groups/e6fc7cd1f8c54bea9922cc2d7328b003/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:15.354449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf61d5-9937-4027-85ed-e278fe586d2f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.354960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf61d5-9937-4027-85ed-e278fe586d2f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.354960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf61d5-9937-4027-85ed-e278fe586d2f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.356508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 143/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:15.362116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc7e2-ab71-49a7-afad-fbe956a249f8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.362975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc7e2-ab71-49a7-afad-fbe956a249f8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.363513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc7e2-ab71-49a7-afad-fbe956a249f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.384823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-79ebc7e2-ab71-49a7-afad-fbe956a249f8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:15.386351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-79ebc7e2-ab71-49a7-afad-fbe956a249f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:15.471380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 155/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:15.714477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873cc3b-05c3-4fe0-b83e-b67962fcaf04 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.715127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873cc3b-05c3-4fe0-b83e-b67962fcaf04 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.715610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873cc3b-05c3-4fe0-b83e-b67962fcaf04 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.717554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 144/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:15.728766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.729360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.729834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.753577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:15.755107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:15.757368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:15.787385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28de255-052a-4cab-a423-bf1b1afd5923 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.787385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28de255-052a-4cab-a423-bf1b1afd5923 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.787385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28de255-052a-4cab-a423-bf1b1afd5923 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.788147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 145/300] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:15.795924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:15.796197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:15.796481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:15.820786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:15.822191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:15.871266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:15.879583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 156/301] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:15.879583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:15.953259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 146/302] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:16.047884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e8e1-7700-4a54-907a-98cdc8ef82f7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.095250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.095889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.096164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.096438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.113913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:16.118662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:16.123969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:16.124885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:16.125680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 157/303] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:16.132645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.260902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5ec13-7c57-4735-92a2-8a5d1be384fd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.304498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.305197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.305482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.305747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.306407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:16.306701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:16.308052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:16.316743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 147/304] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:16.323032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.325293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.376865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:16.461720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab25c9-5eb9-4ef6-bcf0-b6bbbe62db86 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.467398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14806db-e2b5-46c1-a9c8-ec1986e03e36 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.503622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.504227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.504526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.504799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.509015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.509730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.510078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.510441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.521703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:16.527417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:16.528265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:16.529093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 148/305] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:16.530378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.583648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:16.590037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:16.591704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:16.638434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:16.653985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ecc46-7f7a-4b25-b4c3-110e9d0155ba None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.692725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.693459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.693741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.694013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.705489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:16.710711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 158/306] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:16.710953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:16.713641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:16.715543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:16.722339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.722489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 149/307] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:16.722489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.831168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:16.835760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce395536-b9a9-4b41-b2e4-22fda18ad0a2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.859565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ff2-2a18-4d63-86d0-2414664e72a2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:16.879043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.880046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.880419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.881168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.881947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:16.882350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:16.883996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:16.894927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 159/308] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:16.895855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.900218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:16.901124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:16.901571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:16.902034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:16.903326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:16.905189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:16.907379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 150/309] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:16.908384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:16.933579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.019985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1da26a-f7ca-4582-82ff-af74626cccc1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.034125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f357-5cf4-40fc-bd13-c27e2edd7576 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.062541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.063155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.063430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.063700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.064364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:17.064692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.066744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.077439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 160/310] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:17.080060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.085078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.086076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.087160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.087692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.105187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.175712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.177598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf7f3-1c7f-4615-aa31-b57e55af2967 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.204348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.207323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2db1e4-bffa-4ae2-b973-224afca7d381 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.251760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.252395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.253453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.253733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.255648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.257121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.259171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 161/311] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:17.259817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.308090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 151/312] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:17.309545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc3e6-06ee-4a2b-86b8-196a1639e1eb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.309840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc3e6-06ee-4a2b-86b8-196a1639e1eb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.310116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bc3e6-06ee-4a2b-86b8-196a1639e1eb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.311514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 152/313] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:17.312149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bc3e6-06ee-4a2b-86b8-196a1639e1eb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.375953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.390344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c519-50e4-4998-b536-918143b58158 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.429353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.430493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.430809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.430926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bc3e6-06ee-4a2b-86b8-196a1639e1eb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.431317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.453886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.480384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.481309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.481766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.482256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.482982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] RBAC: Adding query filter params (group.id=91eb5366145041188486c1bd0575e4c0, role.id=97a257abeb7a4ede9a810f05489b076d, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:17.483292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.484803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efebf8c-b328-4d48-9a14-abe5b75927e8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.490917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 153/314] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/role_assignments?group.id=91eb5366145041188486c1bd0575e4c0&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=97a257abeb7a4ede9a810f05489b076d => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:17.492239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d57-e032-497a-bd8f-eded17fcdac4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.492607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d57-e032-497a-bd8f-eded17fcdac4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.493042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b5d57-e032-497a-bd8f-eded17fcdac4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.498753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 154/315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:17.499766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b5d57-e032-497a-bd8f-eded17fcdac4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.524432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.526288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c57eb-13fc-4d15-ae2c-f2d9fd8f8900 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.656474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b5d57-e032-497a-bd8f-eded17fcdac4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.664055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.680578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 162/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:17.682302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.682589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.682862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.704492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:17.705896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:17.708137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.710031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.710323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.710651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.711968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.713553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2889ba-887c-45ca-a722-b08328e82734 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.715903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 155/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:17.718432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.718724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.719002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.739713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:17.740994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:17.797902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 163/318] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:17.798672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.804012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.830353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 156/319] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:17.831043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:17.927559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8de1e-892d-4c74-bfa3-1fe55e7f32d9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.950750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:17.968237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:17.968911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:17.969189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:17.969459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] PATH_INFO: `/v3/projects/b2457350eb2c41e3a878c7f43b10bc09` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:17.970631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] RBAC: Authorizing `identity:get_project(project_id=b2457350eb2c41e3a878c7f43b10bc09)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:17.971352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d53e6-9051-4d00-954c-b9e5b0d7d0c8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:17.972059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:17.973726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 164/320] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/projects/b2457350eb2c41e3a878c7f43b10bc09 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:17.979491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.019683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.019683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.019982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.020218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.021348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.022797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.028821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 157/321] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:18.030511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.092448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.106616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f540-b868-4368-a412-c0603ac8e56e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.149596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.150632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.150909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.151182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.152350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.153784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd2d8-b4e0-432c-8dce-d8c94c7841dc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.154000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.155882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 165/322] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 19:08:17 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:18.157289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.197702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.198241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.198518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.198832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.200272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] RBAC: Adding query filter params (group.id=91eb5366145041188486c1bd0575e4c0, role.id=97a257abeb7a4ede9a810f05489b076d, scope.project.id=7fc723822bf54fb1990898adff45938d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:18.200272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.203092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.209567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 158/323] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/role_assignments?group.id=91eb5366145041188486c1bd0575e4c0&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=97a257abeb7a4ede9a810f05489b076d => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:18.210449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.229356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.301131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171521de-a535-459f-9f47-8483a8b6df32 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.346444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.347098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.347373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.347632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.358674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57784c-c268-4732-8ad5-7f027b84a258 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.361545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:18.366722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:18.367740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:18.368667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 166/324] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:18.369828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.385207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.418228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.418871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.419148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.419410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.433642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:18.439645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:18.440552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:18.441347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:18.441926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 159/325] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:18.444889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.499170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed1a7-caf7-48a8-b9a5-c91516a3415d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.521251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.540696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.541302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.541571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.541848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.542581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] RBAC: Adding query filter params (group.id=91eb5366145041188486c1bd0575e4c0, role.id=0a30341733f84c6dbebd64f0f0d6b3d6, scope.project.id=b2457350eb2c41e3a878c7f43b10bc09) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:18.542892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.544312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.550198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 167/326] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/role_assignments?group.id=91eb5366145041188486c1bd0575e4c0&scope.project.id=b2457350eb2c41e3a878c7f43b10bc09&role.id=0a30341733f84c6dbebd64f0f0d6b3d6 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:18.550967 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.575792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c264-ede6-47e1-bf48-98f96d297bcc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.616164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.616825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.617114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.617410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.618187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:18.618607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.620169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.631281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 160/327] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:18.637677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.672075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.673141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1620f6-e80a-4859-b7fc-2aaef0b4c8f5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.709282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.709900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.710181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.710456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.711143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:18.711455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.712902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.722290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 168/328] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:18.729626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:18.758152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe44c-3fb1-4ad4-ae7e-0b825a772421 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.786155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.805022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.806524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.806524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.806798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.852922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9da5-8d6d-470b-9557-63abf950cab3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:18.887282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.888819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:18.893323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:18.893949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:18.894232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:18.894508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:18.925381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:18.982032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:18.982032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.019163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 161/329] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 19:08:19.024946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.040383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:19.114469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 169/330] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:19.120056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.138766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf984b0-62cb-4a30-b5b9-e725cd334253 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.167791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:19.173901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.174532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.174810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.175083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] PATH_INFO: `/v3/projects/7fc723822bf54fb1990898adff45938d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.176193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7fc723822bf54fb1990898adff45938d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.177675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.179300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 162/331] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/projects/7fc723822bf54fb1990898adff45938d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:19.184662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.218073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7216-377c-4a83-b5c6-f935032531be None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.252821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.253450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.253733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.254009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] PATH_INFO: `/v3/projects/aefddd72ecfc4b63a01173e7a0408933` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.255130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] RBAC: Authorizing `identity:get_project(project_id=aefddd72ecfc4b63a01173e7a0408933)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.256598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.258719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 170/332] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/projects/aefddd72ecfc4b63a01173e7a0408933 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:19.264089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.276111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:19.284872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fdb41-abf1-4ea0-ae5e-4ad74e7467f3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.319049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.319676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.319956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.320233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] PATH_INFO: `/v3/groups/91eb5366145041188486c1bd0575e4c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.321759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] RBAC: Authorizing `identity:get_group(group_id=91eb5366145041188486c1bd0575e4c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.323199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.324839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 163/333] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/groups/91eb5366145041188486c1bd0575e4c0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:19.330571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.361949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e4b36-0fb7-40de-b7ac-a3fcc292193b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.394623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.394924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:19.395251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.395870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.396158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] PATH_INFO: `/v3/groups/e6fc7cd1f8c54bea9922cc2d7328b003` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.397294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] RBAC: Authorizing `identity:get_group(group_id=e6fc7cd1f8c54bea9922cc2d7328b003)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.399308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.401021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 171/334] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/groups/e6fc7cd1f8c54bea9922cc2d7328b003 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:19.406783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:19.430273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d8fc-c030-4734-8cd3-38ba11505f86 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.466143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.466772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.467022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.467292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.468009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] RBAC: Adding query filter params (group.id=91eb5366145041188486c1bd0575e4c0, role.id=0a30341733f84c6dbebd64f0f0d6b3d6, scope.project.id=7fc723822bf54fb1990898adff45938d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:19.468315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.469764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56d96-9b7e-494b-890d-a38968bc275a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.475445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 164/335] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/role_assignments?group.id=91eb5366145041188486c1bd0575e4c0&scope.project.id=7fc723822bf54fb1990898adff45938d&role.id=0a30341733f84c6dbebd64f0f0d6b3d6 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:19.487522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:19.513674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb48f7-30af-4ca5-b926-6dfc4cfbccb6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:19.553094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:19.553728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:19.553891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:19.554168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:19.554988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] RBAC: Adding query filter params (group.id=e6fc7cd1f8c54bea9922cc2d7328b003, role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=aefddd72ecfc4b63a01173e7a0408933) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:19.555930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:19.557460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05212f8-078a-4d41-9b63-120b09b6897a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:19.563887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 172/336] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 31 19:08:19 2022] GET /identity/v3/role_assignments?group.id=e6fc7cd1f8c54bea9922cc2d7328b003&scope.project.id=aefddd72ecfc4b63a01173e7a0408933&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:22.293611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597970ed-fd64-43d3-b850-3218d67a33d4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.294677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597970ed-fd64-43d3-b850-3218d67a33d4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.295163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597970ed-fd64-43d3-b850-3218d67a33d4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.296749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 165/337] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:22.308120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117aa64-edcc-4a6d-abb2-61dd6b046ea2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.309041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117aa64-edcc-4a6d-abb2-61dd6b046ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.309518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117aa64-edcc-4a6d-abb2-61dd6b046ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.341448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1117aa64-edcc-4a6d-abb2-61dd6b046ea2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:22.342985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1117aa64-edcc-4a6d-abb2-61dd6b046ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:22.426273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 173/338] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:22.649615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fe0b-158b-421f-99b6-eb54a41c5989 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.650268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fe0b-158b-421f-99b6-eb54a41c5989 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.650752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fe0b-158b-421f-99b6-eb54a41c5989 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.652788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 166/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:22.658326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.658860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.659333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.678227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:22.680367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:22.709741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035d93-6533-4e47-9f76-225d51ea19f5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.710371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035d93-6533-4e47-9f76-225d51ea19f5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.711352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035d93-6533-4e47-9f76-225d51ea19f5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.712925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 167/340] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:22.718450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:22.719136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:22.719611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:22.753116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:22.754662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:22.759263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 174/341] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:22.851807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 168/342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:22.877859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:22.880865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.020903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dc1c7-2c73-4c91-a071-e6123f36aad5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.070047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.071298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.071575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.071890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.088225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.089705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:23.109525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:23.110536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:23.112013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:23.112013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.112013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:23.112013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 175/343] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:23.116620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.117195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.186729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.196631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.239873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaaeb3-e934-493f-af57-723c4ef69330 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.244240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d645a-9a00-4bea-8837-e1d9c969595f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.275942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.276700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.277143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.277430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.282201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.282812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.283090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.283362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.284006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:23.284310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.285772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea7c3-37d6-4e8f-b22c-60bf253340ba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.288861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.290460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.310736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:23.311261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:23.312363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:23.313266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:23.313266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.313266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:23.313433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70098-6936-467e-a569-a7c5b2fa1b52 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.313433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70098-6936-467e-a569-a7c5b2fa1b52 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.313433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70098-6936-467e-a569-a7c5b2fa1b52 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.313619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 176/345] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:23.313619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.313746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 170/346] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:23.314452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70098-6936-467e-a569-a7c5b2fa1b52 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.416520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083617-9f1f-4adc-8426-27cb44202806 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.423940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.427472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70098-6936-467e-a569-a7c5b2fa1b52 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.452764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.453383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.453516 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.453660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.454098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.466534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.466909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.467522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.467787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.468000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.468096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.468901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.470545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b585418e-1bdb-4148-ba91-bab347657d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:23.482373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:23.483261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:23.484059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:23.484059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:23.484059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:23.488498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 177/347] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:23.489736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.490215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.490498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.500774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 171/348] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:23 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:23.500774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.522642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:23.524706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:23.621689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467064d-e543-49fa-ba48-4a1ebb78c9c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.633693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 178/349] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:23.634883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.693939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.694981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.695583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.696089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.697088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:23.702389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.704391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb866c-e9b6-460b-8915-85657249c7f5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.725092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 172/350] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:23.726999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8313a7-29fc-4329-ac50-48f8e814ca47 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.727290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8313a7-29fc-4329-ac50-48f8e814ca47 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.727566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8313a7-29fc-4329-ac50-48f8e814ca47 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.729062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 173/351] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:23.731778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8313a7-29fc-4329-ac50-48f8e814ca47 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.751797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.765427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3738c-7d48-40d1-8b86-b0a0ae149919 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.781987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:23.812622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.814111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.814539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.815222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.816042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:23.816543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.818188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9a72-4aca-4ff4-892c-0895041a1cc6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.838583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 179/352] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:23.840600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.841064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.841501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.857440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8313a7-29fc-4329-ac50-48f8e814ca47 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:23.865427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:23.866834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:23.897301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:23.898736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:23.899116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:23.899579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:23.900482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:23.902354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:23.926299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 174/353] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:23 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:23.927498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:23.950696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 180/354] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:23.964657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.060900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:24.085307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d92a-13bd-44d7-9a1f-7eec035cbba5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.148944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:24.162250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c1608-49de-4181-9bd8-beb3102afa02 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.165038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.165462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.165737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.166012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.183388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.185818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:24.202861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:24.203789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:24.205264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:24.205264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:24.205264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:24.205264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 181/355] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:24.213408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.214308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.214937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.215221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.215495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.216150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.217654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.241426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 175/356] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:23 2022] POST /identity/v3/users => generated 248 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:24.242913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.347631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf55a-ff40-4fd1-93fd-ccec1b2583b7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.360919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff970-ce89-4025-8275-99c33b58f732 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.383101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:24.390568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.391597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.392092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.392631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.393518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:24.394032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.395718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.403971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.404565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.404853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.405133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.406395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.407277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.412598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 182/357] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:24.419434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.423816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 19:08:24.423816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 19:08:24.423816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [parameters: {'id': 'ef083ceb248f4bed83996be7f5366de7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 19:08:24.423816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 19:08:24.449442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return ref.to_dict() Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:08:24.450379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 19:08:24.451258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 19:08:24.452077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:08:24.452969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:08:24.453756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': 'ef083ceb248f4bed83996be7f5366de7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:24.454524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 19:08:24.455318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.456163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 176/358] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 19:08:24 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:24.462539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.495287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:24.550076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed645e2c-e14b-4f57-a232-8693f9a965e1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.595675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.596330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.596650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.596915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.597576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.598999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.600278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad21a1-d702-423d-85ea-3b9ead574ebe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.626067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 183/359] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:24 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:24.647445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.649829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.650110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.650386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.666682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8860f417-302d-4e46-8a83-c93c9af6be7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:24.673278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:24.674212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:24.675103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 177/360] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:24.682422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:24.762811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:24.843383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c79f8-6e8f-4654-884e-e85aa9c956d0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:24.878248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:24.879142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:24.879566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:24.880012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:24.880862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:24.881307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:24.883027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378c4c0-6af6-4de2-82fa-97dd48fb2170 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:24.892260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 184/361] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:26.324317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69336-4a04-46c7-87c3-f4ef1dcfe6cc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:26.325210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69336-4a04-46c7-87c3-f4ef1dcfe6cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:26.325651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69336-4a04-46c7-87c3-f4ef1dcfe6cc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:26.327417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 178/362] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:26.332315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2749c-486c-4751-814f-6469c7f84798 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:26.333087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2749c-486c-4751-814f-6469c7f84798 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:26.334427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2749c-486c-4751-814f-6469c7f84798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:26.356304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dcb2749c-486c-4751-814f-6469c7f84798 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:26.357740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dcb2749c-486c-4751-814f-6469c7f84798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:26.455614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 185/363] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:26.646115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434db6-ff54-41db-8408-b0bd23085196 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:26.646526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434db6-ff54-41db-8408-b0bd23085196 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:26.646907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99434db6-ff54-41db-8408-b0bd23085196 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:26.648802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 179/364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:26.654171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e363d7-a00d-40ff-9ac0-2a3a61ac3379 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:26.654572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e363d7-a00d-40ff-9ac0-2a3a61ac3379 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:26.655028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e363d7-a00d-40ff-9ac0-2a3a61ac3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:26.681574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f1e363d7-a00d-40ff-9ac0-2a3a61ac3379 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:26.682774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f1e363d7-a00d-40ff-9ac0-2a3a61ac3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:26.721498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:26.777249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 186/365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:26.967954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434db6-ff54-41db-8408-b0bd23085196 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.035052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d9ce5-317b-4cc3-951e-8ca8a0ef1113 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.035683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d9ce5-317b-4cc3-951e-8ca8a0ef1113 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.036217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d9ce5-317b-4cc3-951e-8ca8a0ef1113 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.038126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 187/366] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:27.048600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.049253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.049741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.070701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:27.072515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:27.084851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.127354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99434db6-ff54-41db-8408-b0bd23085196 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.186289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.187280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.187784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.188285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.192539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 188/367] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:27.193633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.212357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:27.218168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:27.219024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.219850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:27.232534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 180/368] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:27.234505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.393458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.403906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2070-d683-466f-9d98-10db950f50e1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.433457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513b026-b78c-43b8-bd11-3ec21d0ca97c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.473847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.474767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.475610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.476975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.477476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.477943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.478806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:27.479292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.479751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.480254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:27.482379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:27.484774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.497829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 181/369] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:27.504797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.510170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4242460e-48d4-47c7-b44f-abb696f77cd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:27.515288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:27.516135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:27.517314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 189/370] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:27.522316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ef92-be07-4550-91b4-e54a0aff4ddb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.523193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ef92-be07-4550-91b4-e54a0aff4ddb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.524095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3ef92-be07-4550-91b4-e54a0aff4ddb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.526060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 190/371] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:27.527033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3ef92-be07-4550-91b4-e54a0aff4ddb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.618537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84303-ce32-4874-86a3-ba14c53fb041 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.643550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3ef92-be07-4550-91b4-e54a0aff4ddb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.655641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.656591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.657028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.657568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.669103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:27.670577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:27.677864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.678492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.678771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.679045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:27.688854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:27.689737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:27.690552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:27.690552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:27.690552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:27.690552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 182/372] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:27.690765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:27.690919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cc51a932-5677-4b3e-962c-c63bbd6c3416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:27.696115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:27.697202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:27.698021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 191/373] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:27.698688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48e69-c6d0-460c-8653-27d5df24d87b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.698939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48e69-c6d0-460c-8653-27d5df24d87b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.699208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48e69-c6d0-460c-8653-27d5df24d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.716996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fec48e69-c6d0-460c-8653-27d5df24d87b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:27.718178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fec48e69-c6d0-460c-8653-27d5df24d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:27.732554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.739011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.786845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 192/374] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:27.788110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429aa51-a670-4942-8c2c-63898d174ba0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.788398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429aa51-a670-4942-8c2c-63898d174ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.788774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429aa51-a670-4942-8c2c-63898d174ba0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.790551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 193/375] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:27.791251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429aa51-a670-4942-8c2c-63898d174ba0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.807827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6e0f-0dcd-4736-8b22-b9fc86d9d2bc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.843298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.843910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.844193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.844502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.845151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:27.845455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:27.846831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:27.859892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 183/376] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:27.859892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:27.901381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429aa51-a670-4942-8c2c-63898d174ba0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.937429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:27.938023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.938308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.938567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.939206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:27.939505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:27.940885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046b2a-80e4-4d2a-b987-276aa28d24a2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:27.956509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 194/377] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:27.957762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:27.958053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:27.958324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:27.964989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc03c6-d904-42a5-84de-c834a49ee55b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:27.975475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:27.976620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:27.978026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:27.980194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.001835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.002373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.002641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.002915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.003568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:28.003867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.005265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.013815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 184/378] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:28.014592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.053416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 195/379] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:28.054773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.126182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a046d-ce04-43e5-860d-bb7f4bacaffe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.161015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.161644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.161921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.162349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.168299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f46f6-4b67-415e-8e55-f4ff9f535afb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.174650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.176112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:28.190501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.191586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:28.192413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:28.192413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.192413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:28.192413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 185/380] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.192788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.209115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.209825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.210413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.210413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.218420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.219954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.220650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.222944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:28.239035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.239924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 196/381] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.245895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.305015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0337-ae95-4a82-a962-b3531f1a83c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.342849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.343572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.343853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.344121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.357344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.358794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.366208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbe3cf-4d89-457a-a256-09e1833aaf8f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:28.373188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.374151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:28.374968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:28.374968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.374968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:28.374968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 186/382] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.375620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.400830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.401445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.401727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.401999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.411791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:28.417031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.417902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:28.418677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 197/383] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.419314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.455052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.476854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.478131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33d2ee-feb9-40f5-bacc-89393597d530 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.511321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.511925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.512200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.512480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.513123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:28.513427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.514798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.519677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce34e5e-ded3-4bf4-a50b-7a30b9c50486 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.526100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 187/384] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:28.526885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.553175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.553774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.554054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.554854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.555640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:28.555898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.557375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.598210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 198/385] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:28.598210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.628006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07185-eec1-4512-8f9f-e05dd36a28d1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.661477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.662103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.662379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.662645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.665342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.673837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.675284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:28.690229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.691324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:28.692141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:28.692141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:28.692141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:28.692141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 188/386] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.692541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.695498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41358af-e72d-42d4-bb56-b4df7013e54d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.712205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.729405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.730007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.730282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.730549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.731189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:28.731488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.732949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.744381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 199/387] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:28.745372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.795390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fe5ae-3d75-44de-b729-a3567bb45005 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.832875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.833410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.833789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.834102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.834794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:28.835102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.837039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.844866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 189/388] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:28.845638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.855296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72a28-2277-4e1d-a30d-075b783ab85d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.889482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.890106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.890385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.890667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.896368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.898775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:28.900286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:28.911486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:28.912429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 200/389] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:28.914576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:28.950066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:28.954006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526faaf-7c93-489d-8fbd-badddc8d2965 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:28.987475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:28.988100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:28.988377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:28.988675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:28.999016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.000478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:29.014715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.015699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:29.016553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:29.016553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.016553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:29.016740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe759-1539-4140-9b33-cffdb3bd5b5c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.017222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 190/390] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.017543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.050818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.051415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.051697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.051970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.052652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:29.052954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.054950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.066203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 201/391] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:29.066985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.118199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03c12e-e851-4027-a819-4720dd2f0528 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.119619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.152054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.152718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.152999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.153269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.159646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.162102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.164093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.166382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a387-a8db-49dd-8f9c-d4e71fedc637 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:29.177266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.178244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:29.179143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 191/392] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.180253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.204071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.204725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.204995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.205263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.214929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.216342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:29.231174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.232083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:29.232986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:29.232986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.232986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:29.232986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 202/393] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.233203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.284528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910219ad-88e1-4a43-880e-ff7fa25e6b1c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.318018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.318624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.318905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.319181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.319934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:29.320239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.321715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.330827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf04f-f26a-4458-907d-d06f95d08cad None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.358963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 192/394] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:29.359630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.364996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.365600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.365937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.366212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.368033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:29.368033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.369219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.380873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 203/395] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:29.381478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.381675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.391967 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.464364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023722dc-363a-4441-b26e-7056ba6376d4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.483948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad14b4-4847-4780-8bb5-08a6fc61d1ed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.497752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.498350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.498625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.498892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.499553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.501055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.519027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.519635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.519902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.520172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.520926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:29.521228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.521624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 193/396] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:29 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:29.522420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.522678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.543385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 204/397] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:29.544051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.626980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.627162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.654775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24804d8-d9c2-4854-ae80-2e07a1cf4653 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.671125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870ff4-aff3-4f26-a2cf-7e2233345f45 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.691940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.692679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.692964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.693267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.693928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:29.694401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.696504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.708967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 194/398] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:29.709785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.711431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.712295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.712797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.713268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.724571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.726691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:29.743155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.744057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:29.744907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:29.744907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.744907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:29.744907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 205/399] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.745633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.822678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677b03-aaf1-4781-9170-9e49e1639fa4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.858130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.858775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.859064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.859337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.862470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.868032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.868519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87d98-9ac1-4417-8b27-a8605c7dbb9d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:29.870081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.886913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:29.889678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.890514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:29.891355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:29.892385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 195/400] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.892544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:29.910977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:29.911606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:29.911884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:29.912160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:29.923933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:29.925397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:29.940090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:29.941172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:29.942538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:29.942538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:29.942538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:29.942538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 206/401] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:29.942538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.010997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8afd3b-a6dd-4695-bd55-19d16f923b40 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.048779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.049010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7174a-4e62-44d3-b859-2df660020066 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.049409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.049690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.049965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.058326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.059775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:30.072076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:30.073183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:30.074186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 196/402] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:30.074726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.091381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.091994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.092271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.092582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.093228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:30.093529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.094886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.112492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 207/403] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:30.113368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.138592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.147733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.187402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bc8e-08be-4d3f-b640-0f0d4d9615d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.222919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d1d2-ad89-43d0-b380-2b1a235c4fa2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.227087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.227726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.228005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.228286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.229014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:30.229325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.230766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.255153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 197/404] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:30.255153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.266075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.267035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.267370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.268155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.269258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:30.269574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.271197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.285726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 208/405] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:30.286562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.360381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141ffd2-ab51-4b0d-b0e6-89fb05f9033c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.380010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.394765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.400691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.401304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.401588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.401869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.402604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:30.402915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.404358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.407968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45154d6-34df-42e1-ba70-36a66977f133 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.423001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 198/406] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:30.423638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.453514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.453941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.454222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.454496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.462190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.464190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:30.476558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:30.482786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 209/407] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:30.483834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.550169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cdadb-6e43-42f0-a933-00638aeac635 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.585920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.586573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.586856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.587133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.589234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bec6-4d60-4e03-9d4c-15de6d6cf2ba None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.603497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=b6a804b38ad04a8bb7045e397b4e1cfd, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.604998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.618204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 199/408] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:30 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:30.619358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.639774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.640585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.640873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.641203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.650689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.652533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.661555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:30.668726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:30.669634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:30.670490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:30.675245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 210/409] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:30.676242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.691427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.785563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678a9e-501c-49cd-b7a2-1296f1d5d148 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.813466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277287d-e456-4fa9-9b87-073b0d65599d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:30.840779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.841743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.842195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.842637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.853724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:30.853724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:30.853984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:30.855391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:30.855391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:30.855391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.857552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.859971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:30.863217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:30.880562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 211/410] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:30.881287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:30.882142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:30.883470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:30.883470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:30.883470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:30.883649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.885305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 200/411] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:30.886660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:30.974412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:30.997290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:31.009872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d377-a6c2-43ad-9ddc-76874a6add2f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.025573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae3647-2352-45d9-a628-15c7e6970f04 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.048546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.049297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.049710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.050053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.050838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:31.051281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.052925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.064764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.065668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.065983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 212/412] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:31.066352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.066845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/03e8c5ebd3eb4d1cab97c3d1eaff3f8c/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.066961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:31.084356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=03e8c5ebd3eb4d1cab97c3d1eaff3f8c, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.087069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.104525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 201/413] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:30 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/03e8c5ebd3eb4d1cab97c3d1eaff3f8c/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:31.105767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:31.180260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0310e-79f7-4a13-ac0b-24062d04a2b2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.211038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:31.216876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.217510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.217842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.218099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.218727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:31.219034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.220806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.235944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed110e6-55d3-41cd-82b1-fa9f0c3bfe56 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.236247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 213/414] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:31.242035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:31.269142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:31.284684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.285879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.287168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.287666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/1b15ab0375434a93834a3591da357114/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.314642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=1b15ab0375434a93834a3591da357114, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.316512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.348863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 202/415] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:31 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/1b15ab0375434a93834a3591da357114/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:31.390953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaeb96-fe49-4bbb-b26a-5a5ff2a11c9e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.431461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.432569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.433071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.433590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.442165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.444051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:31.457948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:31.458832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:31.459670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:31.462849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 214/416] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:31.473935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:31.594665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96754-e784-4614-ba51-0d502a17bee5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.631987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.633036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.633429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.633807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.634706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:31.635122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.636763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5cfa0-493f-4d82-8e1f-a9333937c9f7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.650736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 203/417] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:31.656666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:31.711113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:31.763811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f466-0137-42e7-9fd5-09f7d3d867b1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:31.803503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:31.804884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.805336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.805702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/95f9f85aeb8642f2b2b97aff5d1be0e0/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.826798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=95f9f85aeb8642f2b2b97aff5d1be0e0, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:31.828256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04f74a-98a4-42e6-a394-f4b114a7de61 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:31.857464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 215/418] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:31 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/95f9f85aeb8642f2b2b97aff5d1be0e0/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:31.971803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876a86-93d6-4180-b452-73ed54f02102 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.972258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876a86-93d6-4180-b452-73ed54f02102 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.972659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876a86-93d6-4180-b452-73ed54f02102 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:31.974551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 204/419] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:31.981071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:31.981353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:31.981630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:32.005539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:32.006764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:32.105336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 216/420] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:32.458964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876a86-93d6-4180-b452-73ed54f02102 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:32.507378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:32.586174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876a86-93d6-4180-b452-73ed54f02102 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:32.624720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:32.625468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:32.625634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:32.625914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:32.639158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:32.644705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:32.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:32.646340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:32.648710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 205/421] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:32.657443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:32.703848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:32.791246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dab251-d17a-4e25-bf43-4e57fb9e7ef1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:32.836674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:32.837980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:32.837980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:32.837980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:32.839723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:32.839723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:32.841469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:32.852070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 217/422] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:32.857698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.014876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:33.026327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101370-f6dd-430b-9d89-c641582caba8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:33.075946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:33.076524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.076809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.077083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.092187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:33.093695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7439b129-3300-4399-b2fe-d6ce6a4f286f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:33.113362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:33.114301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:33.115111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:33.115111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:33.115111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:33.115111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 206/423] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:33.125661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.287932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:33.303163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06dcf-b334-46e2-a0ae-40f1b14f53d5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:33.332811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58938b3-da27-490e-952c-6be17151b0bb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.333089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58938b3-da27-490e-952c-6be17151b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.333288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58938b3-da27-490e-952c-6be17151b0bb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.334616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 207/424] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:33.340612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.340908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.341185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.363605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:33.364707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.367211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.367786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.368675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:33.370624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:33.372207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:33.374626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:33.376279 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:33.391564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 218/425] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:33.400594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.496326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 208/426] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:33.545915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730312c1-f7a3-4422-8cee-81fecd1d8f8d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:33.581951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:33.582584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.582919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.583136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.590616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:33.592058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:33.604566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:33.605650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:33.606841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 219/427] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:33.611422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.695338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:33.718467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f446a42-df3f-489f-b23e-7d0c4cb79b56 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:33.754485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:33.755095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.755374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.755648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.756374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:33.756712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:33.758332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:33.778074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 209/428] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:33.783163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.799575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:33.886775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b649e0-a91b-4039-8954-3f672a84ad38 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:33.920784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:33.921412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:33.921692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:33.922221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:33.933678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:33.935127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:33.949871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:33.950787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:33.951629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:33.951629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:33.951629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:33.951629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 220/429] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:33.956823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:33.971476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.064662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.086824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4d71-cc55-4276-8b88-41c4be45bf1d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.122741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.123764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.124129 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.124409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.134940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-84fab1ff-9eb6-4e5e-829a-eeb89fb11972 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:34.140308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:34.141544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:34.142512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 221/430] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:34.143296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30e97-2979-43f4-b4a7-affae5100b8c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.143296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30e97-2979-43f4-b4a7-affae5100b8c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.143523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30e97-2979-43f4-b4a7-affae5100b8c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.146346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 222/431] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:34.146346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884f7c5-6b0d-4319-be8c-242c7691357d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.146346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884f7c5-6b0d-4319-be8c-242c7691357d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.146588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884f7c5-6b0d-4319-be8c-242c7691357d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.148036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 223/432] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:34.153335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884f7c5-6b0d-4319-be8c-242c7691357d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.167764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07f8b-5c9c-42b2-b683-f1f5c2a10cc1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.211675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.212280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.212585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.212858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.213487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:34.213788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.215163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004790b5-31d2-4efe-8f7f-45035a7004c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.218181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.229324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 210/433] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:34.230312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.230596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.230867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.253093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:34.254294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:34.264481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884f7c5-6b0d-4319-be8c-242c7691357d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.289346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.300673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.301279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.301560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.301840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.302508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:34.302815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.304227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeaf38-1e62-4c3f-82e5-f0e493c51ffd None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.312991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 224/434] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:34.314042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.314330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.314611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.327648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 211/435] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:34.328692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.342567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:34.343850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:34.440561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 225/436] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:34.440561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.480292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7435-2529-4c4d-b44c-c7835878f8b2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.532392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.548917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.549800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.550277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.550718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.552998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2afd3-ca42-4a93-b653-62916353f4d6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.565013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.566865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.572839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:34.590596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:34.591520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:34.592332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:34.592776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.592776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.592776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.592970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.602414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 212/437] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:34.603511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.605021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.608024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:34.622979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:34.623974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:34.624839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:34.624839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:34.624839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:34.625709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 226/438] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:34.626558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.740043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b409-bcd8-4c65-9221-3fc2b91b9b02 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.751019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8ccb8-0439-4538-9264-a8a4f025b58d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.779871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.780585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.780866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.781141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.781824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:34.782134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.783560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.797105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.798276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.798431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 213/439] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:34.803554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.803629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.803629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.813991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-dc0aa3f4-22b8-48b6-88a5-e0eb0c044b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:34.819242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:34.820725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:34.821520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 227/440] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:34.822528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e585-bb7a-4304-8862-005a507f302d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.822528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e585-bb7a-4304-8862-005a507f302d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.822760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e585-bb7a-4304-8862-005a507f302d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.823966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 228/441] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:34.824659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26e585-bb7a-4304-8862-005a507f302d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.853469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.854788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:34.910845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133b94-6e07-48d8-9759-276a60fd430e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.927713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26e585-bb7a-4304-8862-005a507f302d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:34.945768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.946392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.946668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.946935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.947567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:34.947863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.949258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.965050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 214/442] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:34.965050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:34.965300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:34.965300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:34.965300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:34.965300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/23a46239196c40d1a1529909da19d0fd/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:34.977679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=23a46239196c40d1a1529909da19d0fd, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:34.979139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:34.992095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 229/443] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:34 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/23a46239196c40d1a1529909da19d0fd/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:34.992874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.077105 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090f5f-5cfd-48d9-9b1c-1b69f63631eb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.082555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.086844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.107993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0ec60-c55b-4af8-950d-3188caabe0f3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.120894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.121540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.121818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.122212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.134587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0854ee55-af47-4ef1-bf49-e0feb850c715 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:35.140780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:35.141731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:35.142509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 215/444] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:35.143163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.143737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.143737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.151854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.152499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.152795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.153068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.153749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:35.154048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.155446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.165051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:35.165546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 230/445] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:35.166401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.169350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:35.253576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 216/446] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:35.254353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.282919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda166-d9e5-4fe4-9fb6-6e5227ae0a09 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.327246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.327886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.328166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.328434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.338090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.339603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.342624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:35.355580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:35.356550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:35.357468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:35.363202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 231/447] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:35.363202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.386012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.393924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff52da-36c3-4fd6-b332-e13f8e38f19e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.432355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.433382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.433921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.434399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.435256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:35.435779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.437602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.446844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 217/448] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:35.447935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.484663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1358a4d-3285-4d2a-ab9e-55ca9d82d6ec None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.540184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.540639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.540926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.541205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.561736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.563801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.565725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c2e0-87e5-4894-abb9-efd0caaa6221 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:35.586026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:35.586964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:35.588004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:35.588004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:35.588004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:35.588004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 232/449] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:35.588750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.608718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.609504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.609814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.610091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.610934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:35.611136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.612750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.634176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 218/450] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:35.635032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.661797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.667048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.729203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fa777-189b-4ab0-8845-0a18287ea8d6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.765223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ea06-c0e3-4d65-9daf-641f762c88ec None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.771093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.771732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.772015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.776074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.793099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.795187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:35.811688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.812322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.812635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.812909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:35.816575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:35.817736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:35.819086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:35.819086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:35.819086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:35.819086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 233/451] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:35.820431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.834007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:35.839431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:35.840302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:35.841268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:35.846703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 219/452] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:35.847542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:35.949420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ec29d-3fb9-4946-bed3-b8e6a20a08cc None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.951882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.955425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:35.984913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73c49-3cdb-44a3-9338-38f34e98a053 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:35.994826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:35.995430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:35.995705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:35.995986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:35.996860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:35.998245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:35.999652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.015114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 234/453] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.015707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.033021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.033853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.033962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.034166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.114270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.115650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.162022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903248c-30a7-45c8-ac14-05355add4919 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.202868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.210556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.211163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.211442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.211711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.212356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:36.212681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.214037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.225537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 235/454] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.226870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.235218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 220/455] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:36.236964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.254308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.336571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119647-d0df-4d26-ad86-a775bf16f1d6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.346459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952f41-7e7c-4a43-9ec3-518da7eb390c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.376427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.377041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.377318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.377595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.378257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:36.378561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.379924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.385289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.385915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.386199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.386464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.389189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 236/456] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.394344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.394465 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.395777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:36.408056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:36.409198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 221/457] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:36.415029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.450334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.503165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.518183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7c89-0f0f-4a2a-aa89-7a19e3014a62 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.521025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406cd7-fb41-4864-947d-d6f3ddb41636 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.555780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.556578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.556931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.557201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.557474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.557743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.557953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.558390 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.566325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.567755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.569093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.570929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:36.579347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:36.580203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 237/458] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:36.585973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:36.586566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:36.587368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:36.588201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:36.588201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:36.588201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:36.588201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 222/459] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:36.588201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.681549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.694800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb991-2cee-4e06-be1b-3a3778c93830 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.699729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede69df-e913-4255-8133-e6fe7bbcf557 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.732679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.733287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.733568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.733842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.734256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.734599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:36.734858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.734950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.735139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.735410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.736323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.748492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.749987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.758445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 223/460] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.758445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.759701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:36.770767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:36.771631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:36.776055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:36.776055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:36.776055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:36.776976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 238/461] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:36.777752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.872614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf878f-0ba3-465c-8bb1-10bd6f0d026e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.885531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5eb3-c188-45d7-91d3-9a2bf9e65e54 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:36.915338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.915951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.916499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.916780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.918177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:36.918492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.920615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.924879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:36.925483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:36.925758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:36.926026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:36.926663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:36.926965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:36.928303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:36.946405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 239/462] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.946568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 224/463] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:36.946568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.946755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:36.948189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.010039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.054126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381821f-d3d1-403e-80b2-e195903723a8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.054321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35ae9-6c38-4b98-898e-de792263d193 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.088975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.089580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.089859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.090035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.090157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.090635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.090732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:37.090913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.091065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.091221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.092383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.108240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 225/464] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:37.108240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.168792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.175677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.177343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.207190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47463-c259-4826-a19e-f9ceaca0f5f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.238159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.241793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.242442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.242728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.243001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.249877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.251320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:37.264130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:37.265063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:37.265880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 226/465] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:37.266327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.287497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 240/466] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:37.288353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.369833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa09a-b0e6-4d3b-93a8-9fb6b90ff65c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.384399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15fe4d-1023-4c91-84db-6ba6c97e604a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.392150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.402965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.403566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.403849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.404130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.417827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.418452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.418724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.418992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.426028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.427458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6b979422-4112-4f91-8584-bbc59d2542af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:37.439965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:37.441014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:37.441887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 241/467] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:37.442428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356a0d-4515-48d0-8bcf-a755647f7d2c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.442428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356a0d-4515-48d0-8bcf-a755647f7d2c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.442918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356a0d-4515-48d0-8bcf-a755647f7d2c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.444045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 242/468] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:37.444632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41356a0d-4515-48d0-8bcf-a755647f7d2c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.463922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.476662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.478124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.548428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41356a0d-4515-48d0-8bcf-a755647f7d2c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.578114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 227/469] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:37.578949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.584747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.586016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.586299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.586571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.587265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:37.587992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.589477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.601964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 243/470] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:37.602747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.607360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.680069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.680257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f484e-98e7-4d6c-b959-b52696491a50 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.701704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00845107-099e-40aa-8fcf-1719beef1570 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.714494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.715051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.715327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.715598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.725350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.727004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.734763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.735364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.735649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.735921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.736672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:37.736978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.738382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-67f46b3f-1656-4804-8beb-d586133c5106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:37.742411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:37.743451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:37.744285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:37.744285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:37.744285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:37.744285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 228/471] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:37.744734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.745142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.745362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.761111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 244/472] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:37.761111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.763045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:37.764229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:37.831252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 229/473] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:37.832092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.840989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.862523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d315-357c-4b15-b0e8-4c7aef7f1d2e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.902143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.902784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.903038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.903313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.906470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:37.914837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.916278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:37.931949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:37.933053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:37.933888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:37.933888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:37.933888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:37.933888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 245/474] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:37.934249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:37.945345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db109e6c-8352-4ba1-9865-0703d9e34534 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:37.983596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:37.984194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:37.984489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:37.984806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:37.985487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=b6a804b38ad04a8bb7045e397b4e1cfd) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:37.985796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:37.987207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.004492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 230/475] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/role_assignments?user.id=b6a804b38ad04a8bb7045e397b4e1cfd&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.004492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.062401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a79f-1473-4b59-94c9-b643246d7b98 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.106387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.107596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.107881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.108329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.109116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:38.109422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.109945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.110830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.125664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 246/476] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.130810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.152010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607ea35-7d71-4b7a-9df6-900f11af01bd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.181150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.191455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.192075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.192421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.192769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.244133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9e93-79e4-4b6c-b81c-6b814e59cdd8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.271865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.273971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.282561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.283165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.283443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.283722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.284358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:38.284687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.286059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.298606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 247/477] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.299421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.351872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.394123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 231/478] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:38.394123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.412736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fef23-3453-4dc6-97b7-14e5056bba40 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.422753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.451251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.451883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.452165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.452438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.464827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:38.470563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:38.471424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:38.472215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 248/479] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:38.473624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.520613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28613c-a2e7-4086-813e-d536d2550132 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.556583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.557218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.557502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.557779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.565045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.566528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:38.578296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:38.579338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:38.580746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:38.584041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 232/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:38.585466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.585837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb62d-5f97-43fc-82a3-9186fd5fac96 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.617548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.628561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.629196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.629481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.630207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.637413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.638859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:38.650725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:38.651525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:38.652326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 249/481] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:38.653251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.685287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.698488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b391-530a-4b95-aadd-866350b512ec None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.734896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.735521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.735798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.736068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.747437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.749099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:38.764787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:38.767197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:38.767197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:38.767197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:38.767197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 233/482] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:38.767197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.768928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeac44a-a7e2-439b-82c5-587d3b0143e2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.805143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.805749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.806028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.806299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.807589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:38.807875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.809331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.823246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 250/483] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.823246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.870216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.893503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7b4b-42da-4e61-a183-c1bee40c7722 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.923928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:38.935053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf79f-c371-40e8-89d0-49e1ed677f65 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:38.936725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.938184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.938474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.938749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.939511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:38.939821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.941290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.954745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 234/484] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.955558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:38.975272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:38.976484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:38.976807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:38.977046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:38.977788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:38.978093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:38.979550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:38.992988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 251/485] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:38.994029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.060483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a0f8-f4cb-4929-9b5b-ac8aa6040857 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.095942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff5acd-0c1d-4729-84ef-382f0c47faae None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.097445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.098383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.098725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.098997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.099620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.099917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.101598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.118663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 235/486] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:39.119373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.121993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.133566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.133938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.134214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.134539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.144728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.146192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:39.161367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:39.162272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:39.163231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:39.163231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:39.163231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:39.163231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 252/487] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:39.163452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.166357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.232725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239abc4-9e90-4fdb-9d1b-33aefb6eeae4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.271317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.271672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011986b9-c82b-4503-9a23-3557652b73d5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.273040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.273516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.273927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.274808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=1b15ab0375434a93834a3591da357114) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.275113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.276621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.288875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 236/488] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/role_assignments?user.id=1b15ab0375434a93834a3591da357114&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:39.290471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.312125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.312703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.312912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.313183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.314051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=03e8c5ebd3eb4d1cab97c3d1eaff3f8c) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.314363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.315890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.328991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 253/489] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/role_assignments?user.id=03e8c5ebd3eb4d1cab97c3d1eaff3f8c&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:39.329985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.388529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.437971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba7f7-1676-41ff-b6d3-4d939604eacc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.484282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.485276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.485561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.485837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.492785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.494515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.495999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:39.510157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:39.511050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:39.511851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 237/490] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:39.518410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.562672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519a83-359c-4e93-bd34-0ea39ea6b092 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.619179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.619803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.620086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.620413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.621105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.621411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.623508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.638727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 254/491] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:39.644889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.646059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4877d-484b-4c99-8214-4029ba282e74 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.679003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.690943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.691869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.692343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.692882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.693824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.695258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.696931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.710839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 238/492] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:39.721725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.779723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebf4f5-b901-4dce-b817-38c008bb1a20 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.812976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:39.833359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.834811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.835770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.837375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.849788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.851931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.861413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baef83-a65f-4ce4-b6a7-1ff6eb1eabe1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:39.869171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:39.870088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:39.871023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:39.874303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 255/493] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:39.880365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:39.945293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:39.945873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:39.946154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:39.946431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:39.947164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=95f9f85aeb8642f2b2b97aff5d1be0e0) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:39.947472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:39.948960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:39.960235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 239/494] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/role_assignments?user.id=95f9f85aeb8642f2b2b97aff5d1be0e0&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:40.004166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05fcfa-3900-4a66-a264-fe4278aa53f8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:40.042156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:40.043258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.043737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.044207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.045198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:40.045707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:40.047661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40d5a-ffc6-4971-b08e-1ad26f555e96 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:40.070277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 256/495] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:40.076512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:40.148819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:40.231809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaf125-f441-47f0-a1f9-56751d8a6732 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:40.271208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:40.271823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.272188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.272818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.348338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:40.349765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:40.359881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8043-e3fb-4331-b5bc-5d608976859a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.360162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8043-e3fb-4331-b5bc-5d608976859a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.360438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8043-e3fb-4331-b5bc-5d608976859a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.362254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 257/496] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:40.369475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.369757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.370036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.406778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:40.408321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:40.412489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:40.454822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:40.470864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 240/497] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 19:08:40.477399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:40.490108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 258/498] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:40.596538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c46a3-93a0-4003-b4c4-4232ee146ddd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:40.632943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:40.633339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.633621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.633878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.644234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:40.645807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:40.661043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:40.662016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:40.662931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:40.662931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:40.662931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:40.662931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 241/499] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:40.668078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:40.809809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639419-0e87-406e-a3f3-c5bd3a3fb29a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:40.848289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:40.848935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:40.849217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:40.849493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:40.850146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:40.850729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:40.852407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:40.857480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:40.860401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:40.866780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 259/500] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:40.871247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:40.943266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:41.027150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4ce6-4dc1-4cc0-a47d-91e4431c1e8f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.066319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.066958 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.067242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.067511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.079795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:41.086300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:41.087206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:41.088497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 242/501] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:41.094188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9b3d-db0c-44c5-bd2a-0144c53bd21f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.097392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.148144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.148829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.149111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.149383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.159488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.161698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:41.181252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:41.182230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:41.183185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 260/502] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:41.193557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.207023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:41.258389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5330-e925-4d5e-8ff6-b32602329753 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.307217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.308220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.308781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.309286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.310149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:41.310917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.313502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.332772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 243/503] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:41.338468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.412159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3cc6-a1af-468c-9a3a-c0258a05e09b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.424778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:41.476049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391a14-81dd-49ff-a667-370d0ee565fa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.497163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.497777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.498056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.498330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.499024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:41.499327 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.500780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.502720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:41.515596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.516493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.516950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.517424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.529986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.530912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 261/504] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:41.531902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.536700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:41.548597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:41.549648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:41.550502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:41.550502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:41.550502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:41.553313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 244/505] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:41.566251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.687975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40198-0f0a-4155-ab36-7d64bb8bb8a6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.709265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234498c4-da1f-4ad9-bd6f-f1c0c6cd30d1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.733872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.734864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.735668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.736267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.737265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=23a46239196c40d1a1529909da19d0fd) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:41.737812 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.739604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.747138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 262/506] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/role_assignments?user.id=23a46239196c40d1a1529909da19d0fd&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:41.770005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.770621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.770959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.771235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.777440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:41.777952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.779489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.800329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 245/507] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:41.805707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:41.836036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:41.928938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bf5c-3057-4d57-b670-8d0dcb097ff2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:41.967903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:41.968999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:41.969477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:41.969944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:41.979384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:41.981183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4f43f055-84c5-4c31-8f37-98258227884f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:41.993207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:41.994106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:41.994992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:41.997427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 263/508] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:08:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:42.003065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.048968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:42.096597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb321a6-d1d3-42d2-8f59-d35d7728746f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.097115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb321a6-d1d3-42d2-8f59-d35d7728746f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.097115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb321a6-d1d3-42d2-8f59-d35d7728746f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.098716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 264/509] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:42.103989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11fe0a-a52e-4b03-87cb-7855acbd1429 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.104273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11fe0a-a52e-4b03-87cb-7855acbd1429 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.104580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11fe0a-a52e-4b03-87cb-7855acbd1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.125241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3f11fe0a-a52e-4b03-87cb-7855acbd1429 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:42.126493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3f11fe0a-a52e-4b03-87cb-7855acbd1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:42.130708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d07b4-1835-4f13-b4b7-7504c5081d34 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.170567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.171827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.172310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.172921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.173902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:42.174502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.176178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:42.198744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 246/510] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:42.199567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 265/511] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:42.205844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.318927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b7-a23c-419c-8973-e51d8ef96cfd None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.319298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b7-a23c-419c-8973-e51d8ef96cfd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.319466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b7-a23c-419c-8973-e51d8ef96cfd None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.321114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 266/512] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:42.326225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.326512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.326792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.332483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:42.341687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b446-c788-4f37-a64a-d5fa05688b09 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.346165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:42.347362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:42.349511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:42.384849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.385594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.385932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.386219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.397784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.399315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:42.417090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:42.418074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:42.418950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:42.418950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:42.418950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:42.418950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 247/513] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:42.424105 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.441597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 267/514] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:42.541411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a2c6-f908-4f14-985a-7078eb6fd86c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.576435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.577048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.577336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.577620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.578264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:42.578571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.579955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:42.592726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 248/515] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:42.601792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.690970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.710872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:42.727463 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cbcd1-e6ee-47f1-861b-a2baf5372d3c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.767640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.768269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.768573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.768847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.776865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.778350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:42.791996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:42.792956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:42.793823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:42.796808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 268/516] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:42.797037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:42.801423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.862031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4fe3f-8579-43b6-b768-a1edf1bc756b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.901228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.901959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.902303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.902650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.903314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.904839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:42.917932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:42.919557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:42.927252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 249/517] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:42.928036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:42.940878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392afde2-f04c-40e7-8b83-95b0ef46922e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:42.978060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:42.979049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:42.979521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:42.979985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:42.992186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:42.993977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:43.009100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:43.010082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:43.010962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:43.010962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:43.010962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:43.010962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 269/518] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:43.010962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.026389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.062182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af35c4-2b96-4b40-a4e4-f3328e5f1209 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.067906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.097983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.098594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.098878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.099152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.099834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:43.100194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.102300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93c612-bf4e-45e5-b3ca-9ecf732bf3c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.114329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 250/519] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:43.115445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a299db-1146-4a03-9042-2ed7bf6f673a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.116230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a299db-1146-4a03-9042-2ed7bf6f673a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.117089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a299db-1146-4a03-9042-2ed7bf6f673a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.122408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 251/520] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:43.122408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a299db-1146-4a03-9042-2ed7bf6f673a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.132736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c93123-a4a8-44b9-b5f1-67c213804b10 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.168824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.169268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.169548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.169824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.170455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:43.170758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.172379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.176667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 270/521] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:43.177413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.242282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a299db-1146-4a03-9042-2ed7bf6f673a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.275502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.282983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.283590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.283870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.284144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.284424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808241fa-ab9f-4d53-a08d-3c4150dd38ec None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.284827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:43.285129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.286508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d97c0-323c-40bb-ac7c-eb35698347ad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.299178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 252/522] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:43.299713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.300362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.300738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.300957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.319817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:43.321019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:43.327109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.327766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.328042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.328314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.330256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=b6a804b38ad04a8bb7045e397b4e1cfd, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.331681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.356494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 271/523] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:43 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:43.356494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.414784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 253/524] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:43.415727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.503743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32dfc4-9632-445d-838a-59fddc6a7c91 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.544955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.545564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.545842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.546117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.547002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:43.547305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.548710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.551601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051356ae-44d3-4c6d-a682-e8d28ad92cae None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.556166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 272/525] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:43.576874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.594579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.595199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.595479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.595751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.596437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.597928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.624873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 254/526] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:08:43 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:43.766312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:43.831305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:43.904013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d43d0-98d3-4fd9-92cd-48af66994a5b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:43.940379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:43.941416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:43.941897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:43.942545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] PATH_INFO: `/v3/services/network` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:43.943344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:43.945480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:43.957297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:43.958288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:43.959123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:43.962311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 273/527] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:43 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:43.967870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:44.080776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838052-cf0b-4273-ad9d-303a372ecfd6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:44.118620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:44.119578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:44.120058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:44.120560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:44.121414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:44.121936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:44.123558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0cf9b-8732-4789-8a36-47b616c33e56 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:44.128740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 255/528] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:44.134635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:44.263173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc09e-5c1b-429c-93ec-84085d55b22e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:44.265101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:44.314066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:44.315040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:44.315520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:44.316017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:44.316925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] RBAC: Adding query filter params (type=network) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:44.317489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:44.319123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01355b5d-5c98-491e-bc8f-50747a2ab8fa None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:44.328266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 274/529] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:44.607022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da960e-7b75-497d-bb05-01ab0a15f10b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:44.607431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da960e-7b75-497d-bb05-01ab0a15f10b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:44.607610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da960e-7b75-497d-bb05-01ab0a15f10b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:44.609263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 256/530] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:44.614537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:44.614826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:44.615102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:44.642283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:44.643215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:44.715721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 275/531] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:45.089347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da960e-7b75-497d-bb05-01ab0a15f10b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:45.143907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:45.222141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da960e-7b75-497d-bb05-01ab0a15f10b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:45.269012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:45.269640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:45.269922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:45.270194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:45.291171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:45.296403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:45.297603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:45.298795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 257/532] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:45.304002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:45.480522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:45.488776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8000b-91f2-4294-9a8c-8d33ab13101a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:45.539631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:45.540242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:45.540542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:45.540818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:45.541491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:45.541788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:45.543144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:45.556098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 276/533] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:45.561270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:45.700645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:45.708969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da3554-8410-4337-81bf-76afeb4eb335 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:45.752576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:45.753194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:45.753480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:45.753753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:45.764851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:45.775797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:45.792492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:45.793444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:45.794308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:45.794308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:45.794308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:45.794308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 258/534] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:45.797807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:45.915023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b291d-471d-413d-9519-ae55d1efa83b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:45.961489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:45.962098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:45.962375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:45.962648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:45.963289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:45.963590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:45.964972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b857a0-df2e-4297-ab1a-9ae35c6d2ead None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:45.987735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 277/535] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:45.994123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.036523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3235-43d2-497d-86b3-cabb7aa0d5bb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.036819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3235-43d2-497d-86b3-cabb7aa0d5bb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.037021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d3235-43d2-497d-86b3-cabb7aa0d5bb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.038783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 278/536] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:46.043990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b1cb7-bb28-4186-b5c2-71ab22db3b82 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.044266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b1cb7-bb28-4186-b5c2-71ab22db3b82 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.044638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b1cb7-bb28-4186-b5c2-71ab22db3b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.093612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-056b1cb7-bb28-4186-b5c2-71ab22db3b82 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:46.094816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-056b1cb7-bb28-4186-b5c2-71ab22db3b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:46.118769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:46.170662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a4f2f-713d-490a-a07c-ec43a59e9c09 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:46.173734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 279/537] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:46.186608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29283-1991-4d56-bf8e-b313a65a2e85 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.186892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29283-1991-4d56-bf8e-b313a65a2e85 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.187168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29283-1991-4d56-bf8e-b313a65a2e85 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.192164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 280/538] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:46.193485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.194352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.194694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.213402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:46.214662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:46.269712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:46.270360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.270645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.270922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.284260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:46.292646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 281/539] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 19:08:46.293877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:46.318001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:46.319716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:46.320902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 259/540] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:46.326070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.459026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:46.485259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.488148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f08ca-f3c6-4db4-a48c-19a8fdf769b3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:46.505523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:46.572150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:46.572701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.572983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.573255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.573999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:46.574305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:46.575757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:46.617685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 282/541] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:46.623228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.649442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c50f-c14f-42fa-9eb2-952dc085043b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:46.705552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:46.707085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.707513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.707930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.723174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:46.731640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:46.732800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:46.733850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:46.736632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 260/542] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:46.738075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.765358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40590e-b0c3-451b-9509-aea791f835d5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:46.817673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:46.818553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.819437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.819945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.824254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:46.832881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:46.841970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:46.844140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:46.865714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:46.866729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:46.867594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:46.867594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:46.867594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:46.870613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 283/543] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:46.871740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:46.872697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1233bc-53f8-4bde-af85-9f324a63b4c1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:46.920670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:46.921335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:46.921882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:46.922156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:46.923100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:46.924495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:46.948542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 261/544] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:08:46 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:46.949760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.038833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef38e5c-dbc1-4f4a-ac06-b9e44dfed88c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.094963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.095489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.096155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.096437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.097159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:47.097464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.098893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057996-121f-4898-9ae5-48864868b823 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.100113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42043b4-5827-4948-848f-318fbae14219 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.108521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 284/545] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:47.109648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9003-777c-436c-8af2-9fe926df2f29 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.109936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9003-777c-436c-8af2-9fe926df2f29 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.110212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9003-777c-436c-8af2-9fe926df2f29 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.111682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 285/546] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:47.116832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b664-3abc-478c-8ae0-8f77f3c61ce8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.116832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b664-3abc-478c-8ae0-8f77f3c61ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.116832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b664-3abc-478c-8ae0-8f77f3c61ce8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.118687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 286/547] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:47.119485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b664-3abc-478c-8ae0-8f77f3c61ce8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.137723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.149363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.149976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.150254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.150523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.151181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:47.151464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.152916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600830c-a28a-48a0-84b4-723f6f418f91 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.166604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 262/548] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:47.169709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742449d-6149-4aca-94f8-102b5f68c019 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.169998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742449d-6149-4aca-94f8-102b5f68c019 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.170272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742449d-6149-4aca-94f8-102b5f68c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.180365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.190762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b742449d-6149-4aca-94f8-102b5f68c019 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:47.191960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b742449d-6149-4aca-94f8-102b5f68c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:47.243027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b664-3abc-478c-8ae0-8f77f3c61ce8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.262283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 263/549] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:47.263830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.264759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.265263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.279175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.279932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.280337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.280724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.291780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.293391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.294986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:47.296170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:47.314328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:47.315375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:47.316225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:47.316225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:47.316225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:47.317994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 287/550] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:47.319557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.377527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 264/551] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 19:08:47.377527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.447495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.473830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.483238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a911d-c9f9-4a1f-a4a0-2ba582d368bd None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.508583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fe7bc-01bb-4a8f-9939-3ec6cacce90b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.558255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.559256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.559600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.559931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.563022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.563633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.563913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.564187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.564869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:47.565173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.566539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.567450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.569130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.579046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 265/552] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:47.579975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:47.586714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:47.587799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:47.588714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 288/553] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:47.589210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.709091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34490d2e-9094-4dad-8ae1-c9dbe9b3df3a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.709610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e25449-baf0-4678-afec-a9c842838647 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.721543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.748275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.749010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.749252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.749530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.751935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.752599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.752882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.753153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.757950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.759466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.764449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:47.769717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:47.770623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:47.771430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 266/554] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:47.772505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:47.773376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 289/555] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:47.774339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.779018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.800292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:47.887055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ac59-ecc6-497e-bb5e-42b9d4f952e6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.895276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f106c6-6919-45e6-a49b-c046cd2e76cf None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:47.924594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.925314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.925597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.925876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.926566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:47.926874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.928589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.933225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:47.933827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:47.934105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:47.934375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:47.935020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:47.936389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:47.946049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 267/556] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:47.946049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.960567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 290/557] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:08:47 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:47.960567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:47.977910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.067188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5c6d9-a754-43e5-a845-30a6198610f0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.096730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.125614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.126359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.126645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.126925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.127221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f65e5-2fe3-4e1c-bae9-a83fba7262f0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.127646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:48.127954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.129789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.142249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 268/558] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:48.142918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.175030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.175643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.175925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.176195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.177013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:48.177375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.179479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.202977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 291/559] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:08:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:48.207875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.248794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.265062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25658969-2903-422e-912e-93ab3831ade3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.322034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.322738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.323018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.323294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/23a46239196c40d1a1529909da19d0fd/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.325865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=23a46239196c40d1a1529909da19d0fd, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.328017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.340052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03431ad2-1d97-4dea-b6d4-9e12cc1a53ab None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.348335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 269/560] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:48 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/23a46239196c40d1a1529909da19d0fd/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:48.357284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.391073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.392124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.392616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.393036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.396742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.408652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.410456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:48.430450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:48.431639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:48.432705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:48.432705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:48.432705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:48.434635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 292/561] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:48.440175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.569875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d10e-145f-4fa1-b191-fd7aabc73232 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.621059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.621269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.621555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.621813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.645402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.652323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1e5-bce1-4069-8bdc-20dccd70e568 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:48.722852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:48.725656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:48.727235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:48.727918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:48.729489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:48.730192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.732419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.746979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:48.748846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:48.755799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 293/562] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:48.761343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.870289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.910061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 270/563] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:08:48.915699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:48.984577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:48.994324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283279f0-3b7b-4d6a-bf23-e7b250634b62 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.065282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.065922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.066204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.066483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.083137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.085149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.092315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd28ad1-85b6-4daf-b988-cc9f33b8f5b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:49.109396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:49.110369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:49.111278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 294/564] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:08:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:49.116942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.143121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.143701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.143984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.144269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.156595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.158080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:49.176369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:49.177387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:49.178473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:49.178473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:49.178473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:49.178473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 271/565] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:49.183329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.293862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7684d7-1e8d-4aec-bcb0-b3187588c0f7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.294524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:49.299090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa8ff8-d876-4aad-862f-bd4b17824bb6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.306529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:49.337026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.337735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.338086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.338283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.338509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.339062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.339276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:49.339471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.339700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.339876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.340707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:49.341087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.341388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7105-1b09-42f0-b704-ce865ff4dd76 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.342680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9b7dd-eac4-4353-9e24-78205c16ca39 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.355668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 272/566] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:49.356993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59dba8-507f-4c55-84d3-d14c98a9ac9d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.357278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59dba8-507f-4c55-84d3-d14c98a9ac9d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.357551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59dba8-507f-4c55-84d3-d14c98a9ac9d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.359026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 273/567] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:49.360657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59dba8-507f-4c55-84d3-d14c98a9ac9d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.370698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 295/568] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:49.372035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.372379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.372738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.398756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:49.400721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:49.476166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59dba8-507f-4c55-84d3-d14c98a9ac9d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.493857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 296/569] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:49.494713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.554765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.555524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.555870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.556212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.585364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.586923 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.612296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9cac0-2ae1-42bd-8852-00efb921e66f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:49.618489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:49.619346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:49.620255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 274/570] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:49.621725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:49.629370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.652115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.653078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.653078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.653690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.665164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.667939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.676765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:49.693992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:49.695020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:49.695896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:49.695896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:49.695896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:49.696657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 297/571] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:49.703074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.826727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71562-07de-4097-86f9-272412a53c87 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.872691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2784-a2c6-4d3f-abfe-7ea97ce5c7ef None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:49.878046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.878936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.879447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.879927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.880878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:49.881458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.883196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.896642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 275/572] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:49.897875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.917015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:49.917552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:49.917833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:49.918106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:49.918857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:49.919221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:49.920685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:49.936230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 298/573] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:49.941019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:49.954089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:49.990433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.016058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f278d5-464a-4093-8238-bbdeabd0ece5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.051817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d153-d099-44d6-82b8-5d723785c531 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.056546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.057472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.057962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.058438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.059323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.061182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:50.073131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:50.074119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:50.074965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:50.082359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 276/574] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:50.083545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.086711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.087317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.087594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.087865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.089165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=b6a804b38ad04a8bb7045e397b4e1cfd) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:50.089165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.090630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.097130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 299/575] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:49 2022] GET /identity/v3/role_assignments?user.id=b6a804b38ad04a8bb7045e397b4e1cfd&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.097635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.176431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.209682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc32e-f0ff-44ed-b143-bec7e33ed97b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.251428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.251428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.251428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.251428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.251856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:50.251856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.251856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.256320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 300/576] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.268541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e47f0b-15b1-4305-83eb-bd7f08900011 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.281267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.313049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.314301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.314847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.315348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.324048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.325932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:50.340148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:50.341350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:50.342489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:50.344658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 277/577] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:50.351625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.358304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.482217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c000ad0-b2b9-4a8a-8f7c-6e0c5b8bc4f4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.517671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3970-1a61-4308-83b3-6132d340011f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.522855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747171-8650-4920-83f7-170c861a0494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.523662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747171-8650-4920-83f7-170c861a0494 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.524119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747171-8650-4920-83f7-170c861a0494 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.524573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747171-8650-4920-83f7-170c861a0494 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.525378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33747171-8650-4920-83f7-170c861a0494 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:50.525842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33747171-8650-4920-83f7-170c861a0494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.527832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33747171-8650-4920-83f7-170c861a0494 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.531208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.536434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 301/578] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.537853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d53c-7d2d-4d0c-a5f4-cf4bd81bb590 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.540833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d53c-7d2d-4d0c-a5f4-cf4bd81bb590 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.541325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d53c-7d2d-4d0c-a5f4-cf4bd81bb590 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.544750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 302/579] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:50.548269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24d53c-7d2d-4d0c-a5f4-cf4bd81bb590 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.570912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.572161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.572674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.573346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.574816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:50.575342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.577768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3f8bc-8209-4b56-b01f-95ef1b1fa163 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.595115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 278/580] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.597029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.597744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.598610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.623060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:50.624673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:50.661128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24d53c-7d2d-4d0c-a5f4-cf4bd81bb590 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.692426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.701192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.702209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.702764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.703250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.704170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] RBAC: Adding query filter params (interface=public, service_id=939322685b5a4e0698ed433b6d0cb3fe, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:50.704697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.706330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.708798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 279/581] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:50.709792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.715842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 303/582] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/endpoints?service_id=939322685b5a4e0698ed433b6d0cb3fe&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.721488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:50.872998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:50.914386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b385bd1-bac5-4dcc-bf25-464708653f2a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.931980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426c33f-4a14-4c25-bf33-19f85c360cc3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:50.970143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.970809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.971091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.971366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/3a68508a30c44df59cf10908c9a82eef/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.978629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:50.979542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.980029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.980540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.981359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.983061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f652a-b18f-4b54-9d37-2a48cc6e4593 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.988893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=3a68508a30c44df59cf10908c9a82eef, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:50.990362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:50.991339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 304/583] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:08:50 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:50.993055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952535-5fed-4549-9460-073dce57464c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:50.993707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952535-5fed-4549-9460-073dce57464c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:50.994203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952535-5fed-4549-9460-073dce57464c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:50.996151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 305/584] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:51.004599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:51.004599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:51.004599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:51.012932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 280/585] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:08:50 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/3a68508a30c44df59cf10908c9a82eef/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:08:51.022991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:51.051854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:51.054325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:51.117256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:51.206868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 306/586] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:51.222441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b5e-f0dd-4bc0-9ddd-305e57384d8f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:51.267193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:51.267835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:51.268112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:51.268384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:51.269015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:51.270368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:51.280708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:51.281806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:51.282744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 281/587] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:51.288105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:51.374084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:51.440192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e726542-ec93-47ed-916d-63b489aa2472 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:51.523988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:51.524979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:51.525443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:51.525893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:51.526709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] RBAC: Adding query filter params (name=network) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:51.527249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:51.528830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:51.536399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 307/588] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:51.543535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:51.577752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:51.762785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f41759-a734-422b-a6aa-5d314aed5c04 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:51.787547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296309e-043d-46b6-bb6d-1e952d99d998 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:51.804391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:51.822443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:51.845095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:51.847032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:51.847474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:51.848655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:51.870087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:51.871853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:51.872852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:51.873295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:51.873722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:51.878698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:51.879885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:08:51.880930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:51.882890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:51.883573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:51.885496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:51.890437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 308/589] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:51.898143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:51.904529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 282/590] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:51.906018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:52.167137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a38d8-1332-43cd-a752-c17fce6b8d38 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:52.199936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13deac-a429-4495-a2ba-348862a2df9b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:52.247011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:52.247639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.247922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.248200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.248954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:52.249259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:52.250631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:52.269638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 309/591] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:52.272784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:52.273417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.273702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.273979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.275695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:52.276206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] RBAC: Adding query filter params (interface=public, service_id=a50a7dfe96f94b5c8d3e04676294fa61, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:52.276548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:52.278394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:52.300968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 283/592] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:08:51 2022] GET /identity/v3/endpoints?service_id=a50a7dfe96f94b5c8d3e04676294fa61&interface=public®ion_id=RegionOne => generated 194 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:52.308282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:52.375550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:52.383198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:52.488022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951c2b7-8b34-4b42-a648-03b75486ca2d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:52.525739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f234-3643-49f4-8057-8b7178d60b32 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:52.563063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:52.563063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.563063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.563063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.586977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:52.589105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:52.599772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:52.601158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.601519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.601871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.602564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:52.604022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:52.615050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 284/593] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:08:52 2022] GET /identity/v3/services => generated 772 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-75fd814a-8029-4616-90fd-553a0d6825c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:52.619239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:52.620485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:52.621607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:52.621607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:52.621607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:52.622626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 310/594] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:52.628414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:52.697178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab73e-47c7-4d3c-beb4-562e77bc8387 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.697559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab73e-47c7-4d3c-beb4-562e77bc8387 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.697911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab73e-47c7-4d3c-beb4-562e77bc8387 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.699398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 311/595] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:08:52.712043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.712424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.712794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.743919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:52.747681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:52.822532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:52.827866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c9b1-b7d4-4233-8748-c7eca4678249 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:52.884145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 312/596] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:52.893165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:52.893794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:52.894077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:52.894350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:52.894998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:52.895300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:52.896821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:52.914286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 285/597] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:52.919563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:52.948567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:53.046507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48f6a0-b2cf-4719-9f39-124469ef8e12 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.090084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.091094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.091599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.092092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.102695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.104433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:53.123261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:53.124294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 19:08:53.125332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:53.127608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 313/598] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:08:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:53.137583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.230177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.330134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:53.343969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9b89-f91c-4ce9-bed0-5f28cfe24c6c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.360675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ec101-df51-4383-a571-31b702ffe94c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.386207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.386207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.386207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.386207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.386691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.386691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:53.397208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:53.398228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:53.399111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 314/599] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:53.419321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.446111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.446731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.447010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.447282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.448014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:53.450831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.452304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.486831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 286/600] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:53.504984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.544811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:53.556399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2a0d1-7b91-47d8-9e5f-e809be59430a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.595285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.595847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.596127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.596398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.597060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:53.597362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.599307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.604875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 315/601] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:53.610915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.636817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:53.680409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036a4e-02f1-4fa2-a466-14d20295d9b6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.718560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.719440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.719872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.720248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.738314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266ace3-9adf-428f-98fc-f021f7118ee7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:53.799670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:53.800915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.801358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.801778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.802559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:53.803303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.805580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb94865-060d-48f7-be50-ee62dd4e62d7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.807519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:53.809293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:53.816695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 316/602] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:53.816695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177087cc-8186-49ae-a282-781115cb4477 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.816695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177087cc-8186-49ae-a282-781115cb4477 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.816695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177087cc-8186-49ae-a282-781115cb4477 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.816695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 317/603] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:53.822490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae530-205b-4382-b680-a5e614f1a0b7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.822781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae530-205b-4382-b680-a5e614f1a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.823045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae530-205b-4382-b680-a5e614f1a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.857233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c45ae530-205b-4382-b680-a5e614f1a0b7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:53.858359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c45ae530-205b-4382-b680-a5e614f1a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:53.862370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:53.951279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 318/604] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:08:53.952610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b674c8-73f7-4424-b202-3044e35fac2d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.952896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b674c8-73f7-4424-b202-3044e35fac2d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.953170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b674c8-73f7-4424-b202-3044e35fac2d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.954735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 319/605] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:53.965192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:53.965192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:53.965192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:53.987388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 287/606] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 31 19:08:53.993454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:53.995897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:53.998558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:54.008836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.091895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 320/607] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:08:54.135525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6408b0-197d-4f37-ba26-fd77c8fe22b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.154720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.173993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.174634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.174915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.175192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.186337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.187787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:54.203370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:54.204329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:54.205261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:54.205261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:54.205261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.205261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 288/608] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:54.211275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.236942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.357129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23491320-b6b2-4027-bede-802f75459d5f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.398526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.399091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.399372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.399646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.400753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.402405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.403799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db5cc-ba18-4024-8b22-0dba439e25cf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:54.419299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:54.420337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.421551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 289/609] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:54.422326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.451208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.451913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.452193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.452497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.453132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:54.453431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.454999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.462520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.468319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 321/610] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:54.469330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.476176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.555950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a21dfa-1672-4169-92f1-117c930b25ce None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.587938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b6176-c1e0-44b2-8291-220c76647203 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.597310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.598045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.598332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.598605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.610575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:08:54.615865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:54.616800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:08:54.617635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.621889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 290/611] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:54.622748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.626408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.627015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.627293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.627564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.628214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:54.628531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.629997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.635853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 322/612] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:54.636756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.705674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.752635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.755360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f06c8-dcff-472d-86fb-07cf2fe59af5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.763425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bfea-ec2c-4042-a713-eea779321502 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.800572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.801931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.802738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.803398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.804686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:54.804912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.806288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.815625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 323/613] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:54.816565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.817301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.818187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.818673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.819585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.835200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.837533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:54.853825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:54.854926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:54.856008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:54.859174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 291/614] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:54.860156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:54.938376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a647e-bc42-412e-96b7-2bec5c1011b7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.965491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:54.981090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:54.982748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:54.983258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:54.984027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:54.984954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:54.985642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:54.987979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:54.996181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 324/615] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:54.996359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11be76-13fa-4a2b-b439-aac45ca793c4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:54.997425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.034156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.034907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.035253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.035593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.049737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.051514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:55.068627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:55.069817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:55.070698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:55.070698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:55.070698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:55.070698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 292/616] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:55.071087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.075544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:55.131903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ceb85-1d20-4313-8eb4-16f369f96026 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.175853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.176939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.177369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.178133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.179272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:55.179888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.182108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.186047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9a78-f679-416c-a24d-9368d785981e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.201342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 325/617] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:55.201342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.231091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.231864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.232160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.232768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.233705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.235305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadcf5e-408f-41fc-86b9-f1cb761171f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.252787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:55.259738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 293/618] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:08:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:55.261293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a131-a8de-481a-9597-1c242e5edd86 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.261579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a131-a8de-481a-9597-1c242e5edd86 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.261855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a131-a8de-481a-9597-1c242e5edd86 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.263982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 294/619] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:55.265077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5a131-a8de-481a-9597-1c242e5edd86 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.318685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3655c-f42a-4b30-9d60-7af82b8175b5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.364317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.365906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.366434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.366796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.367538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:55.367914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.369522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965790c-e4fc-483a-8277-82c3dca29e1f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.376098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:55.384926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 326/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:55.386347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.386708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.387054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.406712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:55.408092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:55.435930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5a131-a8de-481a-9597-1c242e5edd86 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.475532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.476150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.476432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.476841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.477691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=23a46239196c40d1a1529909da19d0fd) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:55.478114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.479551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.487160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 295/621] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/role_assignments?user.id=23a46239196c40d1a1529909da19d0fd&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:55.487908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.498028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 327/622] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:55.614224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2345ca-166c-46c0-87d7-7f025a145440 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.642627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:55.657099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.657869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.658155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.658429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.668940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.670421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:08:55.684041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:55.685049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:55.685967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 296/623] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:55.692997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.738215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:55.812704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.820655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def6dfa-7b06-4dd1-89dc-5350e6630a6e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:55.865518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:55.866156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:55.866530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:55.866808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:55.867554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:55.867860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:55.869386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:55.900225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 328/624] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:55.906312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:55.989127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f619e5-a568-4696-81d7-3481d2e0e04e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.030153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.030787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.031079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.031330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.031912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.033312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:56.043055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:56.044090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:56.044969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 297/625] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:08:56.053119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:56.093102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.107131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ac745-425f-4dd6-a22c-52e7aedac289 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.163027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.179627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.180243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.180543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.180817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.251610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433da2d-92dc-4d28-96e0-55d0df18dc35 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.319413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.320915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621457-627e-4f4b-ac57-87160dc45883 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.323895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.324531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.324814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.325085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.325714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:56.326018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.327388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.337953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 298/626] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:56.343150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:56.444482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.462161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 329/627] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:08:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:08:56.462161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d620-95a8-4116-9b83-ca846b7adc91 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.462449 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d620-95a8-4116-9b83-ca846b7adc91 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.462887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d620-95a8-4116-9b83-ca846b7adc91 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.465347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 330/628] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:56.465970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d620-95a8-4116-9b83-ca846b7adc91 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:56.476359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50729-a96b-4f13-8864-cb9a8ae2b020 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.496249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.528283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.529436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.530393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.530955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.531840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:56.532588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.533999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c5b8a-074b-4dac-904d-5c522d1af75f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.540582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 299/629] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:08:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:56.541512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.541797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.542138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.561472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:56.562661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:56.599253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d620-95a8-4116-9b83-ca846b7adc91 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.636312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 300/630] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:56.644725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:56.646270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.650845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.651132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.651407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.668731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.670398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:08:56.686298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:56.687338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:08:56.688219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:08:56.688219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:08:56.688219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:56.688219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 331/631] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:56.700607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:56.745839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.798629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c00ea9-ebfb-449c-9677-aebc6adb8ab7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.807731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:56.836566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9f54-0579-4225-8ce4-444046044d3f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:56.840200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.841398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.842002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.842509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.843381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.845102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.877189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 301/632] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:08:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:08:56.899441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:56.900507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:56.900998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:56.901476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:56.902400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:56.902923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:56.904544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:56.920270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 332/633] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:56.929626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:57.018064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:57.102961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eab92b-7ebe-4456-af53-7bf4731afa80 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:57.158946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:57.159944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.160428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.160961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.168385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:57.170114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:08:57.182727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:57.183603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:08:57.184536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:57.186858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 302/634] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:57.192533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:57.196864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:57.201258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b4c6f-45b8-4fd9-a0d4-ee59cee048c4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:57.225257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:57.256847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:57.257522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.257808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.258092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.259031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:57.260402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:57.290714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 333/635] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:08:57 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:08:57.350413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad8333-f650-460b-a8c4-5429e640e7e5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:57.408116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:57.408691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.408974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.409247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.409950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:57.410255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:57.411701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9560-4547-4c1c-a7c7-64f6423d05b1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:57.426843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 303/636] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:57.433757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:57.546902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a183-8ca6-499a-84d8-b9b1e45f7696 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:57.581940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:57.582857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.583337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.583900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.584900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=3a68508a30c44df59cf10908c9a82eef) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:57.585400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:57.587057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d071beb-c19b-4115-b9ba-40252b3365ad None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:57.593768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 334/637] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:08:57 2022] GET /identity/v3/role_assignments?user.id=3a68508a30c44df59cf10908c9a82eef&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:57.868488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b281e-4c07-43f2-8004-8827ecc32067 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.869020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b281e-4c07-43f2-8004-8827ecc32067 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.869020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b281e-4c07-43f2-8004-8827ecc32067 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.870645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 304/638] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:57.876645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296e07-a984-41e4-b38d-ffed44bbdd1e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:57.877227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296e07-a984-41e4-b38d-ffed44bbdd1e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:57.877704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01296e07-a984-41e4-b38d-ffed44bbdd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:57.898660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-01296e07-a984-41e4-b38d-ffed44bbdd1e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:57.900233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-01296e07-a984-41e4-b38d-ffed44bbdd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:57.919786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:57.976572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 335/639] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:57 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:08:58.002191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f696f-6cf4-4c81-af6b-af272675c032 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.002477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f696f-6cf4-4c81-af6b-af272675c032 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.002790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f696f-6cf4-4c81-af6b-af272675c032 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.004387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 305/640] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:58.009839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.010125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.010401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.029115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:58.030228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:58.098284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 336/641] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:58.258114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f696f-6cf4-4c81-af6b-af272675c032 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.350409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:58.375027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f696f-6cf4-4c81-af6b-af272675c032 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.379563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.421077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.421970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.422251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.422523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.423100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.424483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:58.439768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:58.440823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:08:58.441643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:08:58.450102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 306/642] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:58.451854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.489200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:58.508834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c4411-6a61-4844-a177-50f0703d2fea None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.551978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.553168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.553520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.553728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.554323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.555691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:08:58.565455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:08:58.566432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:08:58.567249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:08:58.572059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 337/643] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:08:58.572939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.596087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8dcc-13bc-43e8-805a-996b1cae373c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.642452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.643512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.643962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.644662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.645849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:58.647046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.648627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.660724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 307/644] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:58.663634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.675545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:58.694426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f00e6-5b5c-4543-b9d6-ae49811b7fde None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.734452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.735673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.736552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.737283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.738092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:58.738567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.740779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.747407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 338/645] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:58.756580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:08:58.785289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a2bff-29fc-472b-bf49-f32cb107a4ed None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.792818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:58.824735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.825766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.826250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.826722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.827540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:58.828040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.829669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984380-a8c3-4fa9-b73f-f606c7b4a0be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.835450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 308/646] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:08:58.889985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e35b6-19f8-491d-81ff-df9d78b290a2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:08:58.928960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:08:58.929946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:58.930447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:58.930922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:58.931805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:08:58.932330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:08:58.933948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eefb1-7b29-477a-8059-19943b1c1afc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:08:58.939817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 339/647] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:08:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:08:59.634249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7c2e-1e1a-44e0-9821-b47388cdf31c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:59.635219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7c2e-1e1a-44e0-9821-b47388cdf31c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:59.635708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a7c2e-1e1a-44e0-9821-b47388cdf31c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:59.637560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 309/648] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:59.643377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384ded-c6b3-4d15-b04e-4aa105c7a74c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:59.644215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384ded-c6b3-4d15-b04e-4aa105c7a74c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:59.644733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384ded-c6b3-4d15-b04e-4aa105c7a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:59.664197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cc384ded-c6b3-4d15-b04e-4aa105c7a74c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:59.665756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cc384ded-c6b3-4d15-b04e-4aa105c7a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:59.740287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 340/649] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:08:59.850512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6538ab-14d2-45a3-a4fe-11d8727364f2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:59.850851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6538ab-14d2-45a3-a4fe-11d8727364f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:59.851058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6538ab-14d2-45a3-a4fe-11d8727364f2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:59.852779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 310/650] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:08:59.858800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:08:59.859084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:08:59.859360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:08:59.871949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:08:59.878452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:08:59.879677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:08:59.952943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 341/651] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:08:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:00.032278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6538ab-14d2-45a3-a4fe-11d8727364f2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.105598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.144370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6538ab-14d2-45a3-a4fe-11d8727364f2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.180312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.181333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.181811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.182286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.183080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.184666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:00.193970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:00.194874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:00.195734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:00.198447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 311/652] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:00.204243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.247888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.314922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680c2c2-6fab-4f3c-910c-d2b2da2a78f5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.356336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.357225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.357429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db61a-c619-4203-a109-daaab303bc7f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.357867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.358317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.359388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:00.360693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.362197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.364152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.369407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 342/653] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:00.374553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.396851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.397743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.398193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.398606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.401188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.412305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:00.417564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:00.418552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:00.419378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:00.422310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 312/654] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:00.428582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.500718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987739-3a9b-4a6b-89d6-3ddea7ebd9c8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.539395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5adee5-597c-4e24-8eb2-54ff27b7638b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.547917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.548982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.549260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.549533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.550169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:00.550478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.551860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.562267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 343/655] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:00.563243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.588278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.588917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.589204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.589481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.590134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:00.590430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.591790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.604601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 313/656] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:00.606919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.652537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.669344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.709050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b061-d9c4-481e-930d-32f4524275c2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.718626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151e0b-ad2d-4532-bd22-533ed7885967 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.756546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.757269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.757461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.757755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.758121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.758539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.759136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.759554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.760701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] RBAC: Adding query filter params (interface=public, service_id=1be9b1504a9442aa944b03da23aa9ca3, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:00.761176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.763157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.770172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 344/657] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/endpoints?service_id=1be9b1504a9442aa944b03da23aa9ca3&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:00.780492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.781683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.783222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:00.804434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:00.805643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:00.806643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:00.806643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:00.806643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:00.812936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 314/658] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:00.814560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:00.906769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493bde-f2b7-413f-b031-fe0ebaf041ad None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.932251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812303d0-a69c-49df-ba3d-bee77ae314db None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:00.940083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.941436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:00.952450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.953302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.953725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.954141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.954887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.956544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.966818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 345/659] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/services => generated 1029 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:09:00.972860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:00.973799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:00.974301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:00.974739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:00.975592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:00.976068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:00.977733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c294d6-be74-4d7f-90ca-c5072ef18f2d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:00.998753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 315/660] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:01.000521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.119341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf835-77de-4cc8-bfcf-f0416774c981 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.119847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf835-77de-4cc8-bfcf-f0416774c981 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.120265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf835-77de-4cc8-bfcf-f0416774c981 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.122697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 316/661] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:01.130122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2adefc-1540-41be-90e6-9da1033b0e7b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.131336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2adefc-1540-41be-90e6-9da1033b0e7b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.132130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2adefc-1540-41be-90e6-9da1033b0e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.133905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1811f81-828d-43d2-9c00-8e218b58c21b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.155862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4d2adefc-1540-41be-90e6-9da1033b0e7b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:01.157080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4d2adefc-1540-41be-90e6-9da1033b0e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:01.172978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.173606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.173887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.174185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.181713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.183179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c55af463-804b-4803-a76f-e43cf4392217 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:09:01.196870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:01.197821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 346/662] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:09:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fc87c-d67d-49c5-beeb-b593f9f206f1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.199873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fc87c-d67d-49c5-beeb-b593f9f206f1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.200595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fc87c-d67d-49c5-beeb-b593f9f206f1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.204627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 347/663] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:01.207294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fc87c-d67d-49c5-beeb-b593f9f206f1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.240504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 317/664] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:01.240504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.240504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.240504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.261286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:01.262697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:01.267531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:01.318543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fc87c-d67d-49c5-beeb-b593f9f206f1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.348939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 318/665] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:01.354608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.355470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.355958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.356389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.357339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:01.357793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.359512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.378520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 348/666] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 19:09:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:01.388512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.415032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:01.491764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930263e4-fa89-4eee-8fae-da2c60c316f2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.526708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.527338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.527615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.527887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.538150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.539809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.540444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:01.555767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:01.556778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:01.557753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:01.557753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:01.557753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:01.561523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 319/667] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:01.562748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.650104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:01.652275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617df3e-f135-43ed-91bd-97caeaaf6c27 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.665115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:01.675454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4be9-cfdf-48e5-8002-21df101af862 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.696072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.697239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.697526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.698081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.698753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.701147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.711755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.712378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.712685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.712960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.713597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:01.713910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.715260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.724956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 349/668] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:01 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:01.726083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.736651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 320/669] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:01.741158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:01.880791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9789a6-fb85-4fd5-88e4-b010b77610f8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.893237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660af31-ee6f-41cc-befb-75c191b43be6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:01.927486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.927712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.927912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.928186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.928896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.930279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.939559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:01.940200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:01.940536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:01.940771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:01.948004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 350/670] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:01 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:01.948640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:01.950178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:01.953287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:09:01.964367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:01.965386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:01.966338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:01.972555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 321/671] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:01.976840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:02.009835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:02.101686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79318f7-268f-4edd-bfe0-b1bd162b2362 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:02.142270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:02.142882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:02.143156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:02.143425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:02.144118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:02.144418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:02.145922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e037e8-9fbf-4155-992c-e6069b09548e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:02.158838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 351/672] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:02.165228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:02.280366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a91fe-e0c8-4c1d-9ad2-e9041ee67d74 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:02.317165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:02.318324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:02.318783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:02.319228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/3a68508a30c44df59cf10908c9a82eef/roles/9b3415ca21044d64bbe212a1bcffef1b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:02.321615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=3a68508a30c44df59cf10908c9a82eef, role_id=9b3415ca21044d64bbe212a1bcffef1b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:02.323292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39512c12-b224-4ef1-b9ed-9e623198f9c1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:02.340313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 322/673] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:09:02 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/3a68508a30c44df59cf10908c9a82eef/roles/9b3415ca21044d64bbe212a1bcffef1b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:09:03.218038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a8083-0abc-486e-916e-c659d829aa88 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:03.218556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a8083-0abc-486e-916e-c659d829aa88 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:03.218672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a8083-0abc-486e-916e-c659d829aa88 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:03.220143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 352/674] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:03.226463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:03.226943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:03.227040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:03.247856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:03.249085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:03.308103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:03.321938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 323/675] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:03.597060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a8083-0abc-486e-916e-c659d829aa88 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:03.684190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:03.706483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a8083-0abc-486e-916e-c659d829aa88 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:03.744566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:03.745599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:03.746085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:03.746580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:03.747376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:03.748982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:03.758822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:03.759763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 19:09:03.761061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:03.763546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 353/676] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 31 19:09:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:03.769213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:03.875465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d8407-83fa-4849-9773-8790d2ff5a51 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:03.913119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:03.913733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:03.914009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:03.914284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:03.914916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:03.915217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:03.916603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:03.922063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 324/677] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:03.928028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.034392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc66718-b724-4874-a9bc-d00460ea8914 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:04.071009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:04.071618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.071896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.072169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.072828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:04.073130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:04.074482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851f7f5-704c-483c-9c2e-60fc81ba770a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:04.079863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 354/678] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:04.085264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.146073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:04.152092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bb91-2b76-45d8-8bca-f52460b8b3e6 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.152374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bb91-2b76-45d8-8bca-f52460b8b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.152677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27bb91-2b76-45d8-8bca-f52460b8b3e6 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.154346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 355/679] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:04.164156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96774e9-c474-4e74-8a87-38b18c62cbd8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.164632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96774e9-c474-4e74-8a87-38b18c62cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.165013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96774e9-c474-4e74-8a87-38b18c62cbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.187719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e96774e9-c474-4e74-8a87-38b18c62cbd8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:04.189313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e96774e9-c474-4e74-8a87-38b18c62cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:04.194673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:04.210463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769146e7-62f0-41ff-9e04-236ac0a6506d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:04.258456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:04.259872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.260642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.261319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.262155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:04.264346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfe424-f932-4f68-b0a5-1dc68a05eb8b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:04.268037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 356/680] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:04.294199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 325/681] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:04.306458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b19d-26d9-4b3a-a660-9749866a36bb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.306980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b19d-26d9-4b3a-a660-9749866a36bb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.307427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06b19d-26d9-4b3a-a660-9749866a36bb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.309313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 357/682] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:04.315479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee7fb-1d0c-44e7-9382-44daa8efe7f4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.315935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee7fb-1d0c-44e7-9382-44daa8efe7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.316316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee7fb-1d0c-44e7-9382-44daa8efe7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.339444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c70ee7fb-1d0c-44e7-9382-44daa8efe7f4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:04.340714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c70ee7fb-1d0c-44e7-9382-44daa8efe7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:04.435155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 326/683] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:04.533481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417045b-54ff-4eaf-a481-17cf0b03fdf6 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.533769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417045b-54ff-4eaf-a481-17cf0b03fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.534025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417045b-54ff-4eaf-a481-17cf0b03fdf6 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.535601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 358/684] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:04.541150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.541438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.541712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.554679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417045b-54ff-4eaf-a481-17cf0b03fdf6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.561655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:04.562839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:04.596020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:04.640129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 327/685] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:04.676652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417045b-54ff-4eaf-a481-17cf0b03fdf6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:04.713645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:04.714559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.714981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.715392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.716159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:04.717736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:04.725429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:04.728069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:04.729053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:04.730942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 359/686] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:04.735152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.746158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:04.853558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cf12-1de3-4310-8da8-981f761ba081 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:04.877049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac823619-2401-4682-a865-2faf6b0e2134 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:04.890574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:04.891546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.891546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.891892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.892625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:04.892987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:04.894455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:04.904153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 360/687] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:04.905667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.925624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:04.926878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:04.927394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:04.927818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:04.928576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:04.930667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:04.940611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:04.941580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:04.942391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 328/688] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:04.943714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:04.975411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:04.983023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.019816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6936a0-e7eb-4755-887c-725de1f6e8ad None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.048872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f167d2-bee1-4b3b-a0b0-ccad378f2425 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.057814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.058422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.058702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.058976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.059612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.059927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.061314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.071660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 361/689] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:05.071660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.093388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.094019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.094295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.094566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.109431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:05.115457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:05.116394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:05.117447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:05.120614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 329/690] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:09:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:05.121723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.186922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49986629-85de-4c69-a630-10267f7f0a90 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.217529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.218068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.225585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.226228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.226512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.226971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.227441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.227817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.229183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.230087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba5b4-0224-4d89-895b-4a688eae4b2b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.235699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 362/691] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.236472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.274695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.275316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.275721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.276062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.276796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] RBAC: Adding query filter params (interface=public, service_id=d18bc097614d4c429674d763b6ea6595, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.277110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.278552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.283763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 330/692] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/endpoints?service_id=d18bc097614d4c429674d763b6ea6595&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.284366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.354063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3da99-ed88-4224-8444-dc6891007b3c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.389895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.390495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.390768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.391076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.391725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.392030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.393410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.394988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b2be-7c9f-47e6-aef7-2574dae79af7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.402126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 363/693] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.407351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.433548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.434156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.434435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.434714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.435325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.435627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.437028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.442296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 331/694] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.443008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.463414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.479608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.523643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd45d1b-a68b-485b-b8a2-5e84ef56d912 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.554073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf7fa9-00d7-4218-8319-aa53fb380d4b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.560925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.561549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.561807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.562082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.562692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.564056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.580487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 364/695] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:09:05.580487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.603109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.603862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.604216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.604588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.619216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.620840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:05.637141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:05.638193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:05.639235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:05.639235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:05.639235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:05.639235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 332/696] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:05.649687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.713131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638da692-f61e-48f8-89d0-cd6bdefe98d0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.734166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.743408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:05.759620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.760255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.760564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.761050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.762666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] RBAC: Adding query filter params (interface=public, service_id=9462744cd1c64963985108b2a8a715ed, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.763199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.766166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.777706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 365/697] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/endpoints?service_id=9462744cd1c64963985108b2a8a715ed&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.780135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfd37-fbf9-476b-a336-1b4f4ceea913 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.782962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.826285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.826900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.827183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.827459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.828112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:05.828417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.829807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.843564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 333/698] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:05.851001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:05.920361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74cc9-705a-43b5-982f-dfee37b7b6bb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.960856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:05.961462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:05.961753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:05.962021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:05.962621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:05.963971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:05.970700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f5878-60b3-4083-a5e7-b369c9ac169a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:05.976604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 366/699] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:09:06.006836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:06.014091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:06.016060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.016668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.017173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.026668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:06.028765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:09:06.046744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:06.047770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:06.048758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 334/700] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:09:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:06.056733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:06.113984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:06.170117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2166-5ddd-4941-93c5-fc7ff66e5364 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:06.206148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:06.206757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.207038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.207310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.208044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:06.208896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:06.210484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a74ea-b760-44fc-8aa8-5214439e6135 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:06.228487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 367/701] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:06.234117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:06.341863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1513e74-2575-4a3d-b682-09361201df4d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:06.379176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:06.380317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.380445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.380890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.448950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:06.461016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:06.462493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:06.548411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba01c-b0b3-4cc0-a1de-3238a27e8dbe None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.548968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba01c-b0b3-4cc0-a1de-3238a27e8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.548968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba01c-b0b3-4cc0-a1de-3238a27e8dbe None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.550520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 368/702] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:06.556416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.556764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.557019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.579919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 335/703] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:09:06.581245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:06.585284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:06.586718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:06.673287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 369/704] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:06.696703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3e78-6326-480f-8faa-ee8e754ed7f5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:06.698654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:06.732920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:06.733552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.733833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.734104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.745211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:06.746653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:06.761545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:06.762472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:06.763764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:06.763764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:06.763764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:06.763764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 336/705] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:06.768536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:06.821642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:06.883815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71582e-4a39-4420-871f-f964f7863e9b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:06.918373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:06.918987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:06.919265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:06.919538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:06.920185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:06.920574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:06.922210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:06.934706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 370/706] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:06.940147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:06.970717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:07.066692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21b360-d875-4b60-a3ec-75c51865f6b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.082888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:07.089146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7539448-7636-49ca-9086-e932ee3f2b31 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.112282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.113340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.113817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.114853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.124299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.126158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.131986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.132701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.132982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.133259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.133842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.135459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:09:07.140246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:07.141225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:07.142104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:07.144377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 337/707] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:07.144504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:07.145439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:07.146284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:07.148601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 371/708] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:07.152568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:07.156195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:07.157675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:07.273342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebe8ea-2a53-4e5d-b61a-ec4909d8789c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.277602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476463-d8db-41e0-be1a-a126d348e2b2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.315894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.316098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.316521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.316630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.316815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.316907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.317069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.317163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.318395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:07.318507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:07.318790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.318886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.320152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.320271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.325612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 372/709] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:07.331206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:07.341569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 338/710] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:07.342628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:07.362930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:07.427824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:07.459736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d6b9-7ef4-4f90-a4bc-55f2d7cea5b4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.470258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ad70b-a76a-4f7e-a77c-1e651b628463 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:07.501116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.502339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.503222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.503979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.504848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:07.505456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.507241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe84dfd-60d4-4b43-a9b1-28ddc36cf699 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.507971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:07.508609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.508893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.509170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.509891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] RBAC: Adding query filter params (role.id=9b3415ca21044d64bbe212a1bcffef1b, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=3a68508a30c44df59cf10908c9a82eef) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:07.510294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:07.511824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50708-ecfd-4fb6-819f-730980c4cde5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:07.519222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 373/712] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:07.524913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 339/712] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:09:07 2022] GET /identity/v3/role_assignments?user.id=3a68508a30c44df59cf10908c9a82eef&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=9b3415ca21044d64bbe212a1bcffef1b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:07.875321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512399-cf7c-4036-a2b0-5bc24b39ba72 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.875871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512399-cf7c-4036-a2b0-5bc24b39ba72 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.875871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512399-cf7c-4036-a2b0-5bc24b39ba72 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.877319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 374/713] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:07.883630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645654a-84a4-4826-928a-9ad845a8a68b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:07.884194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645654a-84a4-4826-928a-9ad845a8a68b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:07.884704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645654a-84a4-4826-928a-9ad845a8a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:07.903581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e645654a-84a4-4826-928a-9ad845a8a68b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:07.905152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e645654a-84a4-4826-928a-9ad845a8a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:07.979909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 340/714] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:08.248199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512399-cf7c-4036-a2b0-5bc24b39ba72 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.298394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6050-2012-4ebc-a26f-2515de1c65cb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.298694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6050-2012-4ebc-a26f-2515de1c65cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.298947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6050-2012-4ebc-a26f-2515de1c65cb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.300586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 341/715] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:08.307178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.307469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.307748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.328313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:08.329561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:08.350940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:08.364820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512399-cf7c-4036-a2b0-5bc24b39ba72 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:08.403549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:08.407852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:08.408957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.409386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.409807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.410541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:08.413249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:08.420494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 342/716] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:08.431946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:08.433119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 19:09:08.433949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:08.436500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 375/717] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:08.444310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.552493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca813e-879b-474a-b52f-d6ebfff8843c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:08.591677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:08.592291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.592623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.592901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.593587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:08.593896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:08.595318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:08.601031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 343/718] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:08.606337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.710949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de79d-c288-4c82-8a79-1fedcecf9666 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:08.720721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.747746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:08.748806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.749245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.749635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.750333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:08.750749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:08.752216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:08.758451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 376/719] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 31 19:09:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:08.764394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.791210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:08.796909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:08.855915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50cd42-a5e6-4202-b304-8d8cf03fcc79 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:08.891079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7bd9e-0499-4891-87cf-257e5a208948 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:08.894874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:08.895654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.896012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.896343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.897059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:08.898499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:08.907921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:08.909183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:08.915423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 344/720] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:08.916242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:08.935714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:08.936319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:08.936600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:08.936878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:08.937551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:08.939038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:08.963834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 377/721] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:09.038782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ff5eb-1b71-4ee6-8665-5c7445aaf458 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:09.055149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:09.087367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:09.088084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.088577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.089048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.090267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:09.090617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:09.092111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:09.098516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 345/722] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:09.104618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:09.195450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:09.223406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90f0c-c12e-4493-aa46-3b852146f29a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:09.259702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:09.260315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.260643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.261061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.261705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:09.262008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:09.263372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbdc87-5728-410b-8384-5b778e0cf245 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:09.268632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 378/723] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:09.275209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:09.385204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa369d3-e8a2-414a-b052-6f5b4245fcef None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:09.426154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:09.426881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.427154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.427428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.428095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:09.429506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a6348-3340-46f4-a917-190ad7e88d2c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:09.456793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 346/724] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:09.869055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7926-4f30-4c3f-b749-9dcda034755e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.869336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7926-4f30-4c3f-b749-9dcda034755e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.869610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7926-4f30-4c3f-b749-9dcda034755e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.871179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 379/725] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:09.876306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.876631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.876912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.888063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f291-0821-434c-8b0c-a8cd05742d1d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.888393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f291-0821-434c-8b0c-a8cd05742d1d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.888644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f291-0821-434c-8b0c-a8cd05742d1d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.890066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 380/726] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:09.896815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:09.897776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:09.898254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:09.900028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:09.901310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:09.919212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:09.921114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:09.927504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:09.983612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 347/727] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:10.006773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 381/728] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:10.255844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:10.279734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:10.357156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:10.379242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f968e-a5de-4348-a29e-515495cbb5ed None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:10.400039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a3fc-e3ca-428e-be7f-1ae2cb90a078 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:10.432864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:10.434295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:10.434758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:10.435235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:10.436057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:10.437453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:10.437837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:10.438225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:10.438570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:10.438915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] PATH_INFO: `/v3/services/image` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:10.439562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:10.441004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:10.450730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:10.451785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:10.452649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:10.456979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 382/729] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 19:09:10 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:10.458563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:10.463804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 348/730] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:10 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:10.576171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580ce8a-3efa-4fe2-b541-e592323b4c46 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:10.609280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:10.623454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:10.624169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:10.624450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:10.624747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:10.625436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] RBAC: Adding query filter params (name=image) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:10.625740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:10.627099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2362e-8e6b-43bd-8111-77b0e51cf0ae None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:10.636557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 383/731] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:10.639262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:10.659568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:10.752708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5671-cec4-4fb4-9442-3d1cb0fa2219 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:10.792829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:10.793454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:10.793735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:10.794009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:10.794647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:10.794948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:10.796599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999beba5-8260-4a0e-8c6b-d62928f0d917 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:10.802337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 349/732] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:11.347968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900b370-0d8c-4be8-bae5-4cc80bba0269 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:11.348562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900b370-0d8c-4be8-bae5-4cc80bba0269 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:11.348682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900b370-0d8c-4be8-bae5-4cc80bba0269 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:11.350225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 384/733] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:11.355723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c4fa-3263-4e0c-95ec-aea14730445a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:11.356010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c4fa-3263-4e0c-95ec-aea14730445a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:11.356281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c4fa-3263-4e0c-95ec-aea14730445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:11.375773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2255c4fa-3263-4e0c-95ec-aea14730445a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:11.376976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2255c4fa-3263-4e0c-95ec-aea14730445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:11.451389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 350/734] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:11.685703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ddac-511f-4f8c-935c-cbf66d8aa865 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:11.686049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ddac-511f-4f8c-935c-cbf66d8aa865 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:11.686229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ddac-511f-4f8c-935c-cbf66d8aa865 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:11.687755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 385/735] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:11.693880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:11.694162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:11.694437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:11.714120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:11.715325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:11.718621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:11.728918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ddac-511f-4f8c-935c-cbf66d8aa865 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:11.808482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 351/736] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:11.852202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ddac-511f-4f8c-935c-cbf66d8aa865 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:11.887970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:11.888591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:11.888873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:11.889142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:11.889786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:11.891261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:11.893861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING keystone.server.flask.common [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 19:09:11.913294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.sql.core [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:11.913294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:09:11.913294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [parameters: {'id': '84682ee804054d72af179a7a6ef79c7a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 19:09:11.913294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84682ee804054d72af179a7a6ef79c7a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84682ee804054d72af179a7a6ef79c7a. Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:11.920475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 19:09:11.921498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application yield resource Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise self.value Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application session.commit() Oct 31 19:09:11.922434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.flush() Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application compat.raise_( Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 19:09:11.923300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 19:09:11.924170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:11.926373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [parameters: {'id': '84682ee804054d72af179a7a6ef79c7a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:11.928550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:11.930430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84682ee804054d72af179a7a6ef79c7a. Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:11.936926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 386/737] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 31 19:09:11 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:11.940493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.045628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16533e-44d3-4dbf-a497-f8ff32880da8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.081825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.082454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.083339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.083665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.085798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.092097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.093707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:09:12.109447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:12.110385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 352/738] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:12.111264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:12.118952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.153759 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:12.219576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0ca66-9761-4dc9-b991-bdf710d2a7d9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.248184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de041171-8136-4b4b-8826-094f2e842131 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.258079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.259121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.259620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.260108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.261219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.263198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:12.273851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:12.274878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:12.275714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:12.283414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 387/739] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:12.284655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.288587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.290605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.291098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.291571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.292443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:12.292967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.295138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.324819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 353/740] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:12.402942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1800-8af6-4e9f-83e9-4442558f7616 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.418261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:12.443805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.444417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.444719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.444987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.445697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:12.446001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.447380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.456353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 388/741] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:12.462431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.531118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:12.575666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49133aa4-8947-4992-ba5a-79584da45d2c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.617368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.618053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.618330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.618600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.619293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:12.619599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.621020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadc359-0d5f-4b73-a51d-92d0265800d6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.626820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 354/742] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:12.633727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.710012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f639b-93ab-4e17-b475-a49e860e0949 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.710340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f639b-93ab-4e17-b475-a49e860e0949 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.710560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f639b-93ab-4e17-b475-a49e860e0949 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.712026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 355/743] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:12.717831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a0d7-4ab7-47f0-8640-f0ea42f11e5e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.718115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a0d7-4ab7-47f0-8640-f0ea42f11e5e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.718388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a0d7-4ab7-47f0-8640-f0ea42f11e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.736907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e51a0d7-4ab7-47f0-8640-f0ea42f11e5e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:12.738095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e51a0d7-4ab7-47f0-8640-f0ea42f11e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:12.750725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a385d6-4f8f-42ff-b206-2914b9488413 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.798600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.799555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.799845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.800121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.801112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] RBAC: Adding query filter params (interface=admin, service_id=9462744cd1c64963985108b2a8a715ed, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:12.801430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.803543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.813810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 389/744] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/endpoints?service_id=9462744cd1c64963985108b2a8a715ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:12.814842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:12.820041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 356/745] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:12.860586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:12.925129 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b129-0e59-4418-b1ce-5b913c237021 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:12.962975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:12.963943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:12.964445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:12.964937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:12.965738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:12.967321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277ed1-dc7b-4c14-8ea5-5f72b80746b8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:12.974446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 390/746] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:12 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:09:13.028901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e430d-c2f6-4905-8ac6-8225e92436e5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.029231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e430d-c2f6-4905-8ac6-8225e92436e5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.029462 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e430d-c2f6-4905-8ac6-8225e92436e5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.031153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 357/747] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:13.037356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.037670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.037915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.058228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:13.059690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:13.104058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e430d-c2f6-4905-8ac6-8225e92436e5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.149100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 391/748] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:13.189296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:13.238822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e430d-c2f6-4905-8ac6-8225e92436e5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.275770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.276808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.277304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.277786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.278559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.280125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:13.290271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:13.291265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:13.292167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:13.298474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 358/749] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:13.301658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.337724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:13.408213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069a886-dbf0-4792-b7d6-0c1e89576a6f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.448136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.449186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.449741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.450237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.451070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:13.451576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.453169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.456359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.467777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 392/750] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:13.469592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.580192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:13.587891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a8acf-e446-4898-85a3-e9fe2c79ceb0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.595909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947442c5-5fe5-4e86-92eb-e4822289d888 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.615657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:13.634541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.635161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.635273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.635466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.635715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.635878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.636201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.636363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:13.636478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.636687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.637186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.638055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.638593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.649831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 393/751] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:13.651289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.659070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 359/752] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:13 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:13.768187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3125a-d70f-4715-858b-dcbe163086e9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.818200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.818847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.819127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.819396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.820112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] RBAC: Adding query filter params (interface=public, service_id=a05d6e4ea0c64fb4bd91a83639803f1b, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:13.820418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.821890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6efee-e549-4f2c-92b7-de502145e310 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.828249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 394/753] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:09:13 2022] GET /identity/v3/endpoints?service_id=a05d6e4ea0c64fb4bd91a83639803f1b&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:13.834642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:13.952023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483686d-3680-4ac3-99f2-35a7a19f93fd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:13.986929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:13.987586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:13.987868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:13.988144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:13.988820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:13.990406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d75bd-d214-4fef-b8f8-8c168256958c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:13.997297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 360/754] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:13 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:09:14.745239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09b00-5fde-4f6d-b8ac-6acef453aabd None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:14.745796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09b00-5fde-4f6d-b8ac-6acef453aabd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:14.745796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09b00-5fde-4f6d-b8ac-6acef453aabd None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:14.747374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 395/755] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:14.752647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6754e6-4f9f-4a5b-bc8d-0574bc6e1a8b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:14.753083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6754e6-4f9f-4a5b-bc8d-0574bc6e1a8b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:14.753272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6754e6-4f9f-4a5b-bc8d-0574bc6e1a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:14.773191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ec6754e6-4f9f-4a5b-bc8d-0574bc6e1a8b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:14.774368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ec6754e6-4f9f-4a5b-bc8d-0574bc6e1a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:14.813994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:14.855671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 361/756] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:15.133938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09b00-5fde-4f6d-b8ac-6acef453aabd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:15.159670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:15.240950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6e64-6a24-4aab-9d30-b00bbe2e6808 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.241593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6e64-6a24-4aab-9d30-b00bbe2e6808 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.242085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6e64-6a24-4aab-9d30-b00bbe2e6808 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.243651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 362/757] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:15.247183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09b00-5fde-4f6d-b8ac-6acef453aabd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:15.248776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.249287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.249633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.267987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:15.269306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:15.284884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:15.285972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.286442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.286887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.287946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:15.289942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:15.308524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.sql.core [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 19:09:15.308524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 19:09:15.308524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [parameters: {'user_id': '336992392640489982d0d824e1e8930f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 19:09:15.308524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:15.318504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:15.319376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application yield resource Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise self.value Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application session.commit() Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 19:09:15.320344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.flush() Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application compat.raise_( Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 19:09:15.321247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:15.322096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:15.322894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [parameters: {'user_id': '336992392640489982d0d824e1e8930f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:15.323681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 31 19:09:15.324432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 396/758] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 31 19:09:15 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:15.331848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:15.365100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 363/759] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:15.431446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:15.447790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bd847-a452-4161-aea6-ff4df3d56ed7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:15.483779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:15.484403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.484714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.484994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.492556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:15.494184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:09:15.506687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:15.507600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.508547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 397/760] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:09:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:15.515343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:15.621212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c301d18-3533-4070-aa0b-7c691c5d5961 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:15.623029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:15.642065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:15.659580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:15.660607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.661638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.662305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.663241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:15.663830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:15.665584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:15.711616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 364/761] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 31 19:09:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:15.772014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5f15-bd4f-47d5-9eb8-417e567d5f92 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:15.811452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:15.812090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.812365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.812669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.813269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:15.814665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:15.824781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:15.825834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:15.826655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 398/762] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 31 19:09:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:15.832542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:15.948777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1735e-8794-4c35-a747-c8a56998faf2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:15.988377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:15.989620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:15.989898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:15.990173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:15.990806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:15.991108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:15.992625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1bd6-38b1-4a12-9a25-bd54acf0be07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:15.998131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 365/763] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:16.003831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.015846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.063301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855f2e-1932-4876-bc87-fb0d8312ea07 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.063579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855f2e-1932-4876-bc87-fb0d8312ea07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.063853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16855f2e-1932-4876-bc87-fb0d8312ea07 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.065222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 366/764] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:16.070607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.070893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.071164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.089792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:16.090982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:16.109637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.112161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa101b-bd6f-4b47-9322-11db3bdb66d7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.156013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.156760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.157034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.157300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.157931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:16.158226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.159768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c6cb2-eb0a-4536-b713-9afb82d4d0c1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.167116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 367/765] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:16.172732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 399/766] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:16.174255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.233939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4721-2ba3-431c-bb09-ab1aaef60c05 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.234265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4721-2ba3-431c-bb09-ab1aaef60c05 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.234486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4721-2ba3-431c-bb09-ab1aaef60c05 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.235914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 400/767] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:16.240811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.241033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.241300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.259785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:16.261739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:16.278908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d19b48-46cb-41af-95d7-cc0c69c4505c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.319773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.320409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.321507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.321782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.322445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.323844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.348494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 368/768] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:16.348706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.356727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 401/769] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:16.437099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.455135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.550460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e373d-350b-4151-803f-0a330872c3d0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.586830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.587466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.587747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.588022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.588664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.590027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:16.598833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:16.599775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.600732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 369/770] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:16.606138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.627277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.708602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.710084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ee699-3064-44dd-97b3-1aa753d0e661 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.733471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7511d4-2511-4ecb-88d6-439fc0ec523a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.747765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.748429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.748735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.749004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.749637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] RBAC: Adding query filter params (name=image) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:16.749937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.751373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.760786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 402/771] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:16.761859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.769893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.771538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.772004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.772488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.773371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.774753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:16.785448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:16.786761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:16.787608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 370/772] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:16.794719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.839133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:16.883474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfa92-3c18-4ccc-931a-11b1c8356e21 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.905196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97a8b-c975-4e33-a2a0-4d45c37ad6f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:16.917665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.918272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.918551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.918878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.919616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] RBAC: Adding query filter params (type=image) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:16.919815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.921514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.932022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 403/773] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:16.933038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.946358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:16.946965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:16.947245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:16.947517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:16.948140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:16.948440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:16.949845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:16.954846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 371/774] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:16.960338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:16.969044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:17.047077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cbe7-c6aa-4c6e-bb18-75b0c872adfa None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:17.060685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca626e56-8d9f-422b-b479-5bbf6d74e49c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:17.078490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:17.090120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:17.090827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:17.091103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:17.091395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:17.092170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] RBAC: Adding query filter params (interface=public, service_id=6d18eaa2d2f847ecad04df02765c6e42, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:17.092502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:17.093855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:17.096678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:17.097291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:17.097580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:17.097841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:17.099397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:17.099846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:17.100780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 404/775] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/endpoints?service_id=6d18eaa2d2f847ecad04df02765c6e42&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:17.101570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:17.106204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:17.107175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 372/776] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 31 19:09:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:17.112653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:17.190985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:17.216607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc378-51c1-41d0-ad21-277b96c85129 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:17.228091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc431-c8f9-4cc4-bdcd-76e55c0b4a3a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:17.256897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:17.257553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:17.257804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:17.258078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:17.258701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:17.260354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c81ee6-8ace-4c8d-bf80-956c48814ddf None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:17.265043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:17.265679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:17.265964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:17.266243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:17.266927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:17.268003 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 405/777] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:09:17 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:09:17.268422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423109ee-cfa1-4ddb-886c-a87ba2a7bdda None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:17.293376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 373/778] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:18.541559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40937-4802-476f-b435-40496e6f5f82 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:18.542087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40937-4802-476f-b435-40496e6f5f82 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:18.542087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40937-4802-476f-b435-40496e6f5f82 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:18.543570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 406/779] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:18.548943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:18.549344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:18.549504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:18.568164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:18.569383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:18.643968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 374/780] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:18.912613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f40937-4802-476f-b435-40496e6f5f82 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:18.970125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:19.017154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f40937-4802-476f-b435-40496e6f5f82 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:19.054549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:19.055182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.055461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.055734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.056860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:19.058293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed7472-dd9b-4c1f-bff0-009c96b5d89b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:19.060083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 407/781] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:19.065734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:19.119195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:19.169590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f1874-ec85-4652-8165-4f07ef316a81 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:19.204098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:19.204732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.205014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.205284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.205941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:19.207405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70333049-b3cf-4828-bde8-74b68db6a852 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:19.240629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 375/782] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:19 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:19.489847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed575c-6277-4dec-802f-d122e6ed735c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.490232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed575c-6277-4dec-802f-d122e6ed735c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.490413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed575c-6277-4dec-802f-d122e6ed735c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.491910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 408/783] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:19.497259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274659-847f-46d5-9e95-317d166440fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.497556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274659-847f-46d5-9e95-317d166440fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.497837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b274659-847f-46d5-9e95-317d166440fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.516853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0b274659-847f-46d5-9e95-317d166440fe None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:19.518042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0b274659-847f-46d5-9e95-317d166440fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:19.580386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9974562-6ec4-4014-b6fc-f446d43118df None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.580969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9974562-6ec4-4014-b6fc-f446d43118df None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.580969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9974562-6ec4-4014-b6fc-f446d43118df None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.582320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 409/784] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:19.588633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:19.588917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:19.589187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:19.595250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 376/785] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:19.609990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:19.611169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:19.678956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 410/786] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:19.872414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274659-847f-46d5-9e95-317d166440fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:19.907967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:19.951874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:19.981188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b274659-847f-46d5-9e95-317d166440fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.008863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.020238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.020915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.021258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.021528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.022121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.023527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:20.033616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:20.034585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:20.035406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 377/787] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 31 19:09:19 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:20.040910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.062958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c6345-f0ec-4dbf-8816-dc78eba321dd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.102202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.102837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.103540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.103828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.115694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:20.120551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:20.121458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:20.122286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 411/788] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:09:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:20.127437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.152854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.157508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadfc41-30b3-4128-848a-3af3917c49f9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.197903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.198506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.198783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.199054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.199676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:20.199976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.201368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.206669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 378/789] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:20.212183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.239751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc936e-04d9-4a6f-9bf2-244bf6c593d0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.252642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.276945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.277553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.277836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.278120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.278780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:20.279089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.280448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.289422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 412/790] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:20.294846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.329529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371d234-bfef-42dd-836d-c43d84afe3be None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.368706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.369393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.369665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.369867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.370499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:20.370809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.372180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.377393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 379/791] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:20.382993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.411629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e9e3-57ef-40f2-94e3-121703000440 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.412095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.451095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.451720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.452005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.452280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.463881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.465349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:20.480931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:20.481882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:20.482767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:20.482767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:20.482767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:20.482767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 413/792] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:20.487700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.491330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c46de-9129-47a5-abb0-7eae68341350 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.517836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.528171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.529029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.529306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.529579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.530249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.531664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.554733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 380/793] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:09:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:20.615571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c50c8-803d-426e-9133-e62c52e7c08f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.660043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.661538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.662083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.662375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.663061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:20.663374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.664804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.678932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 414/794] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:20.684665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.778220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.800859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81dc58-8134-4152-9e46-48416f023f4a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:20.834809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:20.835357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:20.835635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:20.835907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:20.843550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:20.845020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:09:20.856823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:20.857853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:20.858768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 381/795] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:20.865790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:20.950023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:20.969559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb313a4-77ae-42a7-ae88-e69db1e0e9ce None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.003634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.004837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.005104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.005374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.006104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:21.006408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.007821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.025151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 415/796] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:09:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:21.030699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.133806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608541b-1e7c-42a0-a0d8-9f0445b6eda5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.168183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.168839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.169117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.169386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.180991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.182431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.184130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:21.198179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:21.199150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:21.204655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:21.204655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:21.204655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:21.204655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 382/797] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:21.205851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.308383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112887-cc40-4019-b943-9dbdde7f3f46 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.342748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.343367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.343643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.343913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.344600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:21.344905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.346304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a0d3-f6da-482f-b8a7-221f04dfb194 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.356656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:21.366888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 416/798] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:21.367615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.470272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e357cf-1beb-4aff-99b8-35be3d0623bb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.472434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232a3-9e23-433e-93af-bc7c5ac545d8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.472732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232a3-9e23-433e-93af-bc7c5ac545d8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.473551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232a3-9e23-433e-93af-bc7c5ac545d8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.474997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 417/799] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:21.480243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.480569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.480851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.500064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:21.501335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:21.509268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.509880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.510158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.510429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.517294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.518694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:09:21.529783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:21.530661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:21.531541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 383/800] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:21.537146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.573887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 418/801] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:21.591792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:21.636895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c93a7-29e9-469d-ad37-41f18c2bcba9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.669738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.670337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.670870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.671139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.671816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:21.672120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.673569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.685487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 384/802] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:21.691183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.797258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d413-aa27-4802-98cd-87d2fabc30a3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.826876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:21.834447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:21.835111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:21.835396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:21.835678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/9b3415ca21044d64bbe212a1bcffef1b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:21.837843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=b6a804b38ad04a8bb7045e397b4e1cfd, role_id=9b3415ca21044d64bbe212a1bcffef1b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:21.839274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:21.844991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:21.853483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 419/803] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:09:21 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/b6a804b38ad04a8bb7045e397b4e1cfd/roles/9b3415ca21044d64bbe212a1bcffef1b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:09:21.967218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01181bb-971d-48f6-b292-1a398c4bcdea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:21.983041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:22.007322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:22.007971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:22.008252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:22.008555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:22.009697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:22.011144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa8a11-4a03-4aea-aa63-736f468a3b00 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:22.012936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 385/804] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:22.018718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:22.122855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d31ba-6159-4f80-920f-f4797abc2dee None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:22.157678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:22.158285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:22.158563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:22.158836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:22.159494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:22.161628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997c006-7737-401e-aff6-cd6f194af7b9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:22.184880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 420/805] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:09:22 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:22.800182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8dea-1f51-4a00-b1af-d784ed884f90 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:22.800748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8dea-1f51-4a00-b1af-d784ed884f90 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:22.800748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8dea-1f51-4a00-b1af-d784ed884f90 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:22.802243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 386/806] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:22.807237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:22.807631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:22.807792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:22.825589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:22.826761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:22.869700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:22.900814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 421/807] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:23.169519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a8dea-1f51-4a00-b1af-d784ed884f90 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:23.272134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a8dea-1f51-4a00-b1af-d784ed884f90 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:23.306355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:23.306961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:23.307241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:23.307515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:23.308183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:23.309580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:23.317414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:23.317414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:09:23.317414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [parameters: {'id': '63fffa8aec7b49b69ed6de472ddc38e1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 19:09:23.317414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:23.324767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 19:09:23.325588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 19:09:23.326567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 19:09:23.327973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 19:09:23.328915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 19:09:23.329695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '63fffa8aec7b49b69ed6de472ddc38e1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 19:09:23.335038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:23.336190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:23.337499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 387/808] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 31 19:09:23 2022] POST /identity/v3/domains => generated 190 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:23.338430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:23.436900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c59cd-e22f-498d-8400-39a9fc9d48bb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:23.471839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:23.472480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:23.473488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:23.473878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:23.484066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:23.485519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-9b37ac3c-619d-448a-b896-3175cd3deb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:23.499739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:23.500988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:23.502411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:23.502411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:23.502411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:23.502411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 422/809] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:23.506761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:23.560498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:23.617589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e29b5-467b-4524-a6c0-db6239aba3d7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:23.651770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:23.652378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:23.652681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:23.652955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:23.653592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:23.653892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:23.655245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db865946-3135-41a4-92b9-dcd5a0ce4387 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:23.676569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 388/810] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:24.009699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e559f7-4678-4668-bd34-2cd2cd4e08c4 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.010246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e559f7-4678-4668-bd34-2cd2cd4e08c4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.010246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e559f7-4678-4668-bd34-2cd2cd4e08c4 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.011559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 423/811] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:24.016853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf68e3-463f-431e-92b1-b3671b1666dc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.017249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf68e3-463f-431e-92b1-b3671b1666dc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.017394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf68e3-463f-431e-92b1-b3671b1666dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.036438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5ccf68e3-463f-431e-92b1-b3671b1666dc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:24.037562 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5ccf68e3-463f-431e-92b1-b3671b1666dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:24.103564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 389/812] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:24.368825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e559f7-4678-4668-bd34-2cd2cd4e08c4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.398289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:24.405174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc097-bba3-4ee5-81ee-c66cf1ae7038 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.405464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc097-bba3-4ee5-81ee-c66cf1ae7038 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.405738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc097-bba3-4ee5-81ee-c66cf1ae7038 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.407238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 390/813] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:09:24.412123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.412403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.412706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.430265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:24.431421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:24.461590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:24.472549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e559f7-4678-4668-bd34-2cd2cd4e08c4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:24.500147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 391/814] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:24.506292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:24.506922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.507203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.507475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.517887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:24.523178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:24.524217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:24.525557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 424/815] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:24.530034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.627399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf4f5-cdd3-4168-bdda-356435750130 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:24.661379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:24.661977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.662253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.662522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.663173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:24.663469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:24.664850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:24.672843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 392/816] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:24.678511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.763036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:24.771872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.775222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd42ad9-bff6-4543-8396-e951c157943c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:24.806861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:24.811151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:24.811769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.812047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.812316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.823485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:24.824943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:24.838872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:24.840018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:24.841280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:24.841280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:24.841280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:24.841280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 425/817] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:24.845540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.886855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f110f3-4f2e-4086-88ed-39e290aaa71a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:24.920695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:24.921332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.921608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.921879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.933403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:24.938294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:24.939440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:24.940473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 393/818] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:24.946015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:24.947907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95bc95-1871-4e14-9bd8-86afae3aa5b6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:24.982438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:24.983042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:24.983321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:24.983597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:24.984239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:24.984573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:24.985939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:24.994983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:24.998667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 426/819] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:25.004321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.034842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.048289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94fb7-4fdc-4af8-9e3c-57ce69e38a85 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.082655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.083729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.084020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.084306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.085001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:25.085308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.086682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.095150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 394/820] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:25.101653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.106396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046c440-1100-4622-82b0-124d5f1aa71e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.140514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.141085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.141365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.141640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.149323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.150741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:09:25.162119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:25.163085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 427/821] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:09:25.168978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.204790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f84635-1f5d-4974-ab73-2cdd173797c5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.227499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.238816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.239436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.239717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.239985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] PATH_INFO: `/v3/users/9cc19de01b5c4d968be1ff032c1b2e77` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.252930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] RBAC: Authorizing `identity:get_user(user_id=9cc19de01b5c4d968be1ff032c1b2e77)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.254897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.256512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 395/822] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/users/9cc19de01b5c4d968be1ff032c1b2e77 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:25.262080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.269210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80820b5-3570-4694-b2aa-32bf48f5886c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.273704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.303780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.304482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.304771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.305042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.305769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:25.306073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.307476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.324789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 428/823] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:25.330429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.363846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773c4d-b508-4d5c-85e4-fc53175fac20 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.398829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.399505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.399785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.400060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.401252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] RBAC: Authorizing `identity:get_project(project_id=81704cb6de1b4798be51451f9fb0db70)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.402683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.404529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 396/824] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:09:25.410072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.431566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296fcac-2245-421c-be01-e8b882f0470b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.449094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.466101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.466707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.466990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.467261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.486362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.509725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d1e23-f9b8-4667-96fc-6971d9c62579 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.534455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.536436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.543386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.544031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.544308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.544622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70/users/9cc19de01b5c4d968be1ff032c1b2e77/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.546761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=81704cb6de1b4798be51451f9fb0db70, user_id=9cc19de01b5c4d968be1ff032c1b2e77, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.548180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.561724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 397/825] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:09:25 2022] PUT /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70/users/9cc19de01b5c4d968be1ff032c1b2e77/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:09:25.644086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 429/826] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 31 19:09:25.650772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.755255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6446f-5163-4c32-af99-b4fe481b4b7d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.789022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.789656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.789933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.790256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.792981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.803560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.805094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:09:25.820760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:25.821730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:09:25.822678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:09:25.822678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:09:25.822678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:25.822678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 398/827] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:25.827464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:25.845092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:25.923460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769cef6-9235-4077-b45e-8600ce681632 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:25.955755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:25.956352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:25.956660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:25.956931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:25.957896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:25.958197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:25.959554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:25.970627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 430/828] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:25.976762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:26.193259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a047c-ace4-45c8-9483-860d75d9341b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:26.227371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:26.228004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:26.228286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:26.228585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:26.235159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:26.236705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:09:26.248536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:26.249594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:26.256172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 399/829] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:26.256810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:26.333700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:26.354947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc10c5-8f80-45bc-8abc-5de9e2d2dfeb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:26.386694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:26.387291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:26.387572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:26.387847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:26.388568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:26.388876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:26.390292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462927dc-00df-433a-9345-934f0b584b71 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:26.402282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 431/830] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:26.408214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:26.460834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:26.510916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5f453-8ade-44cd-9e89-9ae613fa6af1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:26.544522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:26.545113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:26.545627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:26.545900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:26.546609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] RBAC: Adding query filter params (role.id=9b3415ca21044d64bbe212a1bcffef1b, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=b6a804b38ad04a8bb7045e397b4e1cfd) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:26.546912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:26.548312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e88d61-fe13-418a-bd51-b240cee5de03 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:26.554040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 400/831] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:09:26 2022] GET /identity/v3/role_assignments?user.id=b6a804b38ad04a8bb7045e397b4e1cfd&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=9b3415ca21044d64bbe212a1bcffef1b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:27.716755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872b6d-30bb-42be-8855-c13b35b70128 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:27.717278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872b6d-30bb-42be-8855-c13b35b70128 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:27.717364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872b6d-30bb-42be-8855-c13b35b70128 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:27.718622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 432/832] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:27.724240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:27.724665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:27.724834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:27.743094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:27.744275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:27.809558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 401/833] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:09:28.078740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872b6d-30bb-42be-8855-c13b35b70128 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.176875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872b6d-30bb-42be-8855-c13b35b70128 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:28.209038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:28.209646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:28.209924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:28.210196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:28.216688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:28.220375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:28.225988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:28.227051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:28.228196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 433/834] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:28.233017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.276280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:28.330630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fefcb-267a-43e1-b0c2-c7ef9e9bee54 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:28.363216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:28.363882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:28.364158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:28.364428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:28.365107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:28.365403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:28.366759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:28.374507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 402/835] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:28.381224 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.478126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638169a-4a31-49f4-932f-da933d2877f3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:28.510793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:28.511402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:28.511680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:28.511952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] PATH_INFO: `/v3/users/9cc19de01b5c4d968be1ff032c1b2e77` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:28.513059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] RBAC: Authorizing `identity:get_user(user_id=9cc19de01b5c4d968be1ff032c1b2e77)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:28.514477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:28.516011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 434/836] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/users/9cc19de01b5c4d968be1ff032c1b2e77 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:28.522062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.619781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc74439-dc93-48c7-8f7c-cbc650f0e604 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:28.621977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:28.653078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:28.653670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:28.653947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:28.654219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:28.720203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:28.721666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:28.818788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 403/837] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:09:28.824692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.891689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:28.926751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aa822-ebf5-4145-aa30-d6eb11da0f1e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:28.960557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:28.961171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:28.961450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:28.961730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:28.962839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] RBAC: Authorizing `identity:get_project(project_id=81704cb6de1b4798be51451f9fb0db70)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:28.964253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184394-fe0c-4269-a1b4-68f100375d6f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:28.965880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 435/838] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:28.971920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:28.974986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:29.068302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe904c9-4b71-4bf7-b691-056d8dac164e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:29.101367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:29.101947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:29.102225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:29.102495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:29.103202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=81704cb6de1b4798be51451f9fb0db70, user.id=9cc19de01b5c4d968be1ff032c1b2e77) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:29.103506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:29.104949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35233223-6197-4894-86e3-7a13c181ed68 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:29.110483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 404/839] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:09:28 2022] GET /identity/v3/role_assignments?user.id=9cc19de01b5c4d968be1ff032c1b2e77&scope.project.id=81704cb6de1b4798be51451f9fb0db70&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:31.233914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbea4b-94d4-45d1-92aa-e004b85d5c00 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:31.234422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbea4b-94d4-45d1-92aa-e004b85d5c00 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:31.234540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbea4b-94d4-45d1-92aa-e004b85d5c00 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:31.235798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 436/840] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:31.241665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:31.242039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:31.242209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:31.260508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:31.261682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:31.324071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:31.329878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 405/841] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:31.605454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbea4b-94d4-45d1-92aa-e004b85d5c00 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:31.703668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbea4b-94d4-45d1-92aa-e004b85d5c00 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:31.735237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:31.735842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:31.736122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:31.736392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:31.737501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:31.739430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f1b20-cd2b-4a9f-8e20-845ead49ebfd None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:31.740978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 437/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:31.746644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:31.842531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec4f3d-0764-46c1-acef-41de373606d7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:31.874851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:31.875385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:31.875660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:31.875931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:31.876610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:31.878011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b38e-c0b0-4001-b038-34f05fb73914 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:31.899680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 406/843] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:09:31 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:09:34.038068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724669-01de-47ad-bdfa-d2c100b8a2b2 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.038604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724669-01de-47ad-bdfa-d2c100b8a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.038604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724669-01de-47ad-bdfa-d2c100b8a2b2 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.039846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 438/844] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:34.044901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.045571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.045721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.063339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:34.064533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:34.113101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:34.130832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 407/845] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:34.397674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724669-01de-47ad-bdfa-d2c100b8a2b2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:34.400528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:34.496964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724669-01de-47ad-bdfa-d2c100b8a2b2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:34.529392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:34.529997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.530274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.530543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] PATH_INFO: `/v3/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.531886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] RBAC: Authorizing `identity:get_role(role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:34.533255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:34.534536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 439/846] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:34 2022] GET /identity/v3/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:34.540278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:34.635685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b38536-4f4e-4446-b6c1-6188c470a42c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:34.667786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:34.668342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.668649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.668922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] PATH_INFO: `/v3/users/c0b9409eef854f91b27f352a060ccc03` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.682224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] RBAC: Authorizing `identity:get_user(user_id=c0b9409eef854f91b27f352a060ccc03)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:34.683658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:34.685231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 408/847] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:34 2022] GET /identity/v3/users/c0b9409eef854f91b27f352a060ccc03 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:34.690814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:34.757477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:34.787310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de30ecc-0c99-4a3d-b47a-c11ee4c45cc5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:34.819810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:34.820430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.820739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.821012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.822107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] RBAC: Authorizing `identity:get_project(project_id=81704cb6de1b4798be51451f9fb0db70)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:34.823524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899159-8354-4a71-8e89-16ee8403479c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:34.825166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 440/848] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:34 2022] GET /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:34.830955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:34.873784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:34.930180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948106e6-2b73-4c3f-80dd-1abf8b41162b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:34.963203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:34.963839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:34.964113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:34.964381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70/users/c0b9409eef854f91b27f352a060ccc03/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:34.966473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=81704cb6de1b4798be51451f9fb0db70, user_id=c0b9409eef854f91b27f352a060ccc03, role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:34.967880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f84abf-be1e-4b09-833a-4f6c693778c2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:34.980162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 409/849] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:09:34 2022] PUT /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70/users/c0b9409eef854f91b27f352a060ccc03/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:09:37.100237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1cff4-a21a-4fd4-b66a-47c1e814a465 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:37.100776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1cff4-a21a-4fd4-b66a-47c1e814a465 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:37.100776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1cff4-a21a-4fd4-b66a-47c1e814a465 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:37.102046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 441/850] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:37.107136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:37.107577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:37.107669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:37.125870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:37.127028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:37.191769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 410/851] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:37.485647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1cff4-a21a-4fd4-b66a-47c1e814a465 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:37.605008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1cff4-a21a-4fd4-b66a-47c1e814a465 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:37.642482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:37.643082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:37.643365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:37.643640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] PATH_INFO: `/v3/roles/0a30341733f84c6dbebd64f0f0d6b3d6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:37.645210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] RBAC: Authorizing `identity:get_role(role_id=0a30341733f84c6dbebd64f0f0d6b3d6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:37.646581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:37.648083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 442/852] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:37 2022] GET /identity/v3/roles/0a30341733f84c6dbebd64f0f0d6b3d6 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:37.654784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:37.689657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:37.768542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822abee-4708-4972-afc4-e88e58c5d16c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:37.807292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:37.807924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:37.808205 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:37.808499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] PATH_INFO: `/v3/users/c0b9409eef854f91b27f352a060ccc03` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:37.809664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] RBAC: Authorizing `identity:get_user(user_id=c0b9409eef854f91b27f352a060ccc03)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:37.811715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:37.815077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 411/853] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:37 2022] GET /identity/v3/users/c0b9409eef854f91b27f352a060ccc03 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:37.821882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:37.834528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:37.969246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d488f-20ac-40ae-b53b-84c4239f204b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:38.014679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:38.015374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:38.015652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:38.016255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:38.084284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:38.085681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:38.092867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:38.179546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 443/854] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:09:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:09:38.185482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:38.280978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:38.283879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4158a32-6ba0-46bc-8cff-2f6be601427a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:38.318677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:38.319297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:38.319576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:38.319844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] PATH_INFO: `/v3/projects/81704cb6de1b4798be51451f9fb0db70` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:38.320966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] RBAC: Authorizing `identity:get_project(project_id=81704cb6de1b4798be51451f9fb0db70)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:38.322386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd23856-9149-43a6-8382-7877d9cc3c30 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:38.323982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 412/855] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:38 2022] GET /identity/v3/projects/81704cb6de1b4798be51451f9fb0db70 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:38.330262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:38.426455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d20d3-8620-41c7-8952-a55e7467a816 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:38.433595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:38.460574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:38.461173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:38.461454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:38.461731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:38.462452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] RBAC: Adding query filter params (role.id=0a30341733f84c6dbebd64f0f0d6b3d6, scope.project.id=81704cb6de1b4798be51451f9fb0db70, user.id=c0b9409eef854f91b27f352a060ccc03) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:38.462764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:38.464189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a386e-62f0-4d23-95b9-c31a1c8b40cc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:38.469797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 444/856] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:09:38 2022] GET /identity/v3/role_assignments?user.id=c0b9409eef854f91b27f352a060ccc03&scope.project.id=81704cb6de1b4798be51451f9fb0db70&role.id=0a30341733f84c6dbebd64f0f0d6b3d6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:40.612416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33339e4-71f0-4245-8fc4-6cf33487fdde None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:40.613490 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33339e4-71f0-4245-8fc4-6cf33487fdde None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:40.613490 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33339e4-71f0-4245-8fc4-6cf33487fdde None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:40.614845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 413/857] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:40.619994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:40.620395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:40.620594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:40.638799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:40.639973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:40.705092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 445/858] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:40.977213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33339e4-71f0-4245-8fc4-6cf33487fdde None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:41.075968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33339e4-71f0-4245-8fc4-6cf33487fdde None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:41.108906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:41.109514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:41.109792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:41.110068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:41.111154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:41.113138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238222db-6e9e-4edf-8367-735f5e0c5a35 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:41.114819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 414/859] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:41.120546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:41.211817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:41.214704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2926-ff84-4f3f-b2f9-8d9ad1106fe4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:41.247688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:41.248220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:41.248524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:41.248801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:41.249438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:41.250844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d186ec-3674-4517-95fd-7cb932b081fe None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:41.275963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 446/860] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:41 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:43.433066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007c6b-9e04-40d2-bb90-9ad6dddf2341 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:43.433598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007c6b-9e04-40d2-bb90-9ad6dddf2341 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:43.433598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007c6b-9e04-40d2-bb90-9ad6dddf2341 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:43.434920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 415/861] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:43.440346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:43.441287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:43.441477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:43.459758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:43.460956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:43.523945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 447/862] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:43.800638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007c6b-9e04-40d2-bb90-9ad6dddf2341 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:43.835828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:43.898936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007c6b-9e04-40d2-bb90-9ad6dddf2341 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:43.931647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:43.932252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:43.932554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:43.932826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:43.933898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:43.935309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd3b3-15be-492c-933c-ba43e6e8c362 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:43.936842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 416/863] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:09:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:43.943150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:44.023529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:44.042474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e311-f0c8-4be5-98eb-c11f92d441ea None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:44.076715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:44.077310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:44.077593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:44.077868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:44.078509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:44.079919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1d6d6-62fc-44ff-b85e-9d4ec9a3d48c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:44.101316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 448/864] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:09:43 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:46.339874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152022e-4fb2-4990-9ac3-ca07c748f7eb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:46.340447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152022e-4fb2-4990-9ac3-ca07c748f7eb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:46.340447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152022e-4fb2-4990-9ac3-ca07c748f7eb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:46.341771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 417/865] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:46.347354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:46.347769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:46.347964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:46.366180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:46.367383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:46.431435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 449/866] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:46.699197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152022e-4fb2-4990-9ac3-ca07c748f7eb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:46.797861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152022e-4fb2-4990-9ac3-ca07c748f7eb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:46.800738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:46.831696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:46.832312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:46.832630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:46.832901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:46.842626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:46.847455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:46.848783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:09:46.849895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 418/867] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:46.854542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:46.919000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:46.951381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d430df-9fa2-4086-9d5e-7a6bcb1d363e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:46.984683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:46.985274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:46.985553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:46.985826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:46.986484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:46.986783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:46.988753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:46.996373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 450/868] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:47.002172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:47.099759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90a99-1587-4f15-965f-337874b3707d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:47.132637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:47.133247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:47.133526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:47.133798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] PATH_INFO: `/v3/users/2ee15d474be14922b4fd0239391df950` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:47.146358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee15d474be14922b4fd0239391df950)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:47.147785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:47.149369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 419/869] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:47 2022] GET /identity/v3/users/2ee15d474be14922b4fd0239391df950 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:47.155033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:47.253723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed185b-f2af-429b-bf9a-5b3f4374ea04 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:47.281073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:47.287896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:47.288534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:47.288813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:47.289084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] PATH_INFO: `/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:47.290162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] RBAC: Authorizing `identity:get_project(project_id=7c79f7c107b145a39f1d2b29b99b0cc8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:47.291574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a368b-054a-4316-afcd-6dd9bf0ab178 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:47.293197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 451/870] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:47 2022] GET /identity/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:47.299327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:47.322821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:47.399938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550b8fd-1306-4a73-ab18-d505e0db0633 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:47.433283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:47.433924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:47.434201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:47.434474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] PATH_INFO: `/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8/users/2ee15d474be14922b4fd0239391df950/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:47.436311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c79f7c107b145a39f1d2b29b99b0cc8, user_id=2ee15d474be14922b4fd0239391df950, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:47.437765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2019e-37bf-4f91-9cb8-49dc2f7ddd22 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:47.449770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 420/871] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:09:47 2022] PUT /identity/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8/users/2ee15d474be14922b4fd0239391df950/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:09:49.555194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053962c-63e0-4390-bfc5-c2db88b6ef47 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:49.555727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053962c-63e0-4390-bfc5-c2db88b6ef47 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:49.555727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053962c-63e0-4390-bfc5-c2db88b6ef47 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:49.557096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 452/872] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:49.562374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:49.562795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:49.562918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:49.581840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:49.583027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:49.648626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 421/873] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:49.913443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053962c-63e0-4390-bfc5-c2db88b6ef47 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.010071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053962c-63e0-4390-bfc5-c2db88b6ef47 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.041478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.042081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.042356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.042625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.052999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:09:50.057683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:09:50.058562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:09:50.059380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 453/874] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:09:50.064696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.079492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:50.162550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5e43-2b71-4f45-b6bd-df03703abd33 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.195061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.195588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.195862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.196132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.196806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:50.197104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:50.198458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:50.206690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 422/875] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:50.212450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.268365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:50.308804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9f62-5dee-49e9-be48-3ef8aaff4ba8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.341232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.341848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.342132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.342404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] PATH_INFO: `/v3/users/2ee15d474be14922b4fd0239391df950` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.343508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] RBAC: Authorizing `identity:get_user(user_id=2ee15d474be14922b4fd0239391df950)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:50.344956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:50.346530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 454/876] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:09:50 2022] GET /identity/v3/users/2ee15d474be14922b4fd0239391df950 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:50.352347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.426714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:50.450904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1e2b8-6d85-4c64-a304-4ff84840ce7c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.483514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.484111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.484392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.484692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.550534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:50.551952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:50.622483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:50.647343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 423/877] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:09:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:09:50.653393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.751011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea9e70-7394-43fe-82fd-9b0496413abe None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.775949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:50.785368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.785992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.786272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.786547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] PATH_INFO: `/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.787655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] RBAC: Authorizing `identity:get_project(project_id=7c79f7c107b145a39f1d2b29b99b0cc8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:50.789110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953ad4-4709-43f7-b6fa-5682a5c493a7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:50.790728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 455/878] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:09:50 2022] GET /identity/v3/projects/7c79f7c107b145a39f1d2b29b99b0cc8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:50.796956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:50.892565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d47af-4f4c-4ddf-9524-067cbe56ef6f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:50.925740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:50.926325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:50.926600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:50.926868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:50.927581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=7c79f7c107b145a39f1d2b29b99b0cc8, user.id=2ee15d474be14922b4fd0239391df950) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:09:50.927892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:50.929323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3772cc0-48f7-43d3-ae59-e6789abceba6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:50.934917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 424/879] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:09:50 2022] GET /identity/v3/role_assignments?user.id=2ee15d474be14922b4fd0239391df950&scope.project.id=7c79f7c107b145a39f1d2b29b99b0cc8&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:53.070268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612d9e-43eb-41ec-8a9d-f97e268d3f18 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:53.070785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612d9e-43eb-41ec-8a9d-f97e268d3f18 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:53.070785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68612d9e-43eb-41ec-8a9d-f97e268d3f18 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:53.072060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 456/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:53.077138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165765-9e92-4ab0-aa3e-19288e6d3d02 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:53.077549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165765-9e92-4ab0-aa3e-19288e6d3d02 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:53.077669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165765-9e92-4ab0-aa3e-19288e6d3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:53.095978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-51165765-9e92-4ab0-aa3e-19288e6d3d02 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:53.097231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51165765-9e92-4ab0-aa3e-19288e6d3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:53.126483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:53.164374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 425/881] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:53.438910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68612d9e-43eb-41ec-8a9d-f97e268d3f18 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:53.536643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68612d9e-43eb-41ec-8a9d-f97e268d3f18 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:53.568831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:53.569415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:53.569688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:53.569956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:53.570614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:53.571951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94219acd-5dff-4978-8833-baa0b4978b6c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:53.587509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 457/882] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Oct 31 19:09:53 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:55.749239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d52c-4c73-4040-a6a4-2f4857f45adc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:55.749795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d52c-4c73-4040-a6a4-2f4857f45adc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:55.749795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d52c-4c73-4040-a6a4-2f4857f45adc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:55.751097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 426/883] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:55.757005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:55.757424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:55.757561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:55.775926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:55.777520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:55.825121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:55.843192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 458/884] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:56.113187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d52c-4c73-4040-a6a4-2f4857f45adc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:56.214980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d52c-4c73-4040-a6a4-2f4857f45adc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:56.248221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:56.248859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:56.249138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:56.249408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] PATH_INFO: `/v3/domains/0e2f341343e74b45808c361fccf1e012` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:56.259503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e2f341343e74b45808c361fccf1e012)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:56.260974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bc99a-dee3-4b19-ad71-6bf40847de44 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:56.262506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 427/885] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 31 19:09:56 2022] GET /identity/v3/domains/0e2f341343e74b45808c361fccf1e012 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:56.268834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:56.363565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53cde-1267-42c2-8fc0-048c72fe663d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:56.396338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:56.396965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:56.397244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:56.397515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:56.398196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:56.399627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133651c-4707-4379-961d-e626e2591d53 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:56.425994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 459/886] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:09:56 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:09:58.588233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173df44-802d-4517-b88e-b266215faac3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:58.588821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173df44-802d-4517-b88e-b266215faac3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:58.588821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173df44-802d-4517-b88e-b266215faac3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:58.590118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 428/887] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:09:58.595252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:58.595730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:58.595827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:58.614140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:09:58.615298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:09:58.642873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:58.681213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 460/888] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:09:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:09:58.949979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173df44-802d-4517-b88e-b266215faac3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:58.978242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:09:59.049502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173df44-802d-4517-b88e-b266215faac3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:59.083980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:59.084623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:59.084902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:59.085173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] PATH_INFO: `/v3/domains/0e2f341343e74b45808c361fccf1e012` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:59.086261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=0e2f341343e74b45808c361fccf1e012)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:59.087677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec56e-898b-4546-bbaa-8178476a93fa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:59.089218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 429/889] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 31 19:09:58 2022] GET /identity/v3/domains/0e2f341343e74b45808c361fccf1e012 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:09:59.094897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:09:59.188195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf5e2-8842-4384-9001-9afc09d15d7b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:09:59.221019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:09:59.221879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:09:59.222160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:09:59.222433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:09:59.223090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:09:59.224529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9555ef-5bb3-4fcc-980f-dc747264e501 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:09:59.245093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 461/890] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:09:59 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:10:01.430565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f37d9-70ea-47a0-92b3-8271221d2703 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:01.431153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f37d9-70ea-47a0-92b3-8271221d2703 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:01.431153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f37d9-70ea-47a0-92b3-8271221d2703 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:01.432581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 430/891] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:10:01.438077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485764-0805-4062-8d33-abbf935b508e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:01.438493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485764-0805-4062-8d33-abbf935b508e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:01.438639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485764-0805-4062-8d33-abbf935b508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:01.458200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1c485764-0805-4062-8d33-abbf935b508e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:10:01.459380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1c485764-0805-4062-8d33-abbf935b508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:10:01.475237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:01.635817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 462/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:10:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:10:01.905349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f37d9-70ea-47a0-92b3-8271221d2703 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:01.998569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:02.005172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f37d9-70ea-47a0-92b3-8271221d2703 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:02.037632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:02.038134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:02.038410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:02.038678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:02.048630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:10:02.053928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:10:02.055059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:10:02.056166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 431/893] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:10:02.060951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485764-0805-4062-8d33-abbf935b508e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:02.153764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485764-0805-4062-8d33-abbf935b508e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:02.186029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:02.186613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:02.186886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:02.187157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:02.187800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:10:02.188093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:02.189467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:02.197470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 463/894] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:02.203060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:02.301118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90ce2-492e-4686-aefc-3b7c0edf0640 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:02.334009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:02.334638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:02.334930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:02.335371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] PATH_INFO: `/v3/users/2d712cae6a1e48e5bb3a807436875bf2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:02.348790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2d712cae6a1e48e5bb3a807436875bf2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:02.350221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:02.351824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 432/895] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:10:02 2022] GET /identity/v3/users/2d712cae6a1e48e5bb3a807436875bf2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:02.357572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:02.373348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:02.453172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e971c28-3c7d-4b20-958d-002c815e25be None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:02.484666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:02.485276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:02.485554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:02.485827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] PATH_INFO: `/v3/projects/7921580dc82f491e876b92878883b554` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:02.487410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] RBAC: Authorizing `identity:get_project(project_id=7921580dc82f491e876b92878883b554)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:02.488835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebd9b6-e922-4908-b37d-8b25017d7d36 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:02.490424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 464/896] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:10:02 2022] GET /identity/v3/projects/7921580dc82f491e876b92878883b554 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:02.496197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:02.511927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:02.593699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba74f1-448b-4f29-a44d-d566e28725f5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:02.626509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:02.627361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:02.627670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:02.627946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] PATH_INFO: `/v3/projects/7921580dc82f491e876b92878883b554/users/2d712cae6a1e48e5bb3a807436875bf2/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:02.629846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] RBAC: Authorizing `identity:create_grant(project_id=7921580dc82f491e876b92878883b554, user_id=2d712cae6a1e48e5bb3a807436875bf2, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:02.631254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48430a-bb08-4c60-90b5-a88f18aa9d4c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:02.643149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 433/897] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:10:02 2022] PUT /identity/v3/projects/7921580dc82f491e876b92878883b554/users/2d712cae6a1e48e5bb3a807436875bf2/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:10:04.757384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e67f7-0ac5-40ce-92bd-6cee44e58c2c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:04.757957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e67f7-0ac5-40ce-92bd-6cee44e58c2c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:04.757957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e67f7-0ac5-40ce-92bd-6cee44e58c2c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:04.759249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 465/898] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:10:04.764428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:04.764864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:04.765064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:04.784339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:10:04.785544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:10:04.850207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 434/899] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:10:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:10:05.121010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e67f7-0ac5-40ce-92bd-6cee44e58c2c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:05.202020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:05.221860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e67f7-0ac5-40ce-92bd-6cee44e58c2c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:05.255017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:05.255631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:05.255916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:05.256189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:05.265957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:10:05.271802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:10:05.272951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:10:05.274151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 466/900] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:10:05.278842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:05.281891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:05.374810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13938ab6-7e47-4e9b-bf9a-b8dff166fd46 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:05.407674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:05.408821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:05.409249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:05.409529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:05.410178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:10:05.410475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:05.411832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:05.419567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 435/901] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:05.426336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:05.524424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933cf3-621d-48e5-8658-86c55bab7246 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:05.557889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:05.558502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:05.558784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:05.559062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] PATH_INFO: `/v3/users/2d712cae6a1e48e5bb3a807436875bf2` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:05.560176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] RBAC: Authorizing `identity:get_user(user_id=2d712cae6a1e48e5bb3a807436875bf2)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:05.561629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:05.563184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 467/902] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 31 19:10:05 2022] GET /identity/v3/users/2d712cae6a1e48e5bb3a807436875bf2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:05.569026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:05.633070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:05.667794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6e1ac-67ee-45e3-aec4-0cdc4f92bdd1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:05.700588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:05.701178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:05.701458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:05.701731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:05.766940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:05.768563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:05.830785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:05.866600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 436/903] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:10:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:10:05.872552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:05.884675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:05.969503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f974b-02a1-4e13-9563-9be8d798de0a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:06.001401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:06.002628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:06.002911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:06.003186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] PATH_INFO: `/v3/projects/7921580dc82f491e876b92878883b554` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:06.004287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] RBAC: Authorizing `identity:get_project(project_id=7921580dc82f491e876b92878883b554)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:06.005731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f4681-bae6-4b23-990d-ffc2b3d67f7b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:06.007319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 468/904] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 31 19:10:05 2022] GET /identity/v3/projects/7921580dc82f491e876b92878883b554 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:06.013409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:10:06.109933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79a5e-06c3-4e14-8a8a-133c7729e360 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:10:06.143810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:10:06.144319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:10:06.144625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:10:06.144897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:10:06.145607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=7921580dc82f491e876b92878883b554, user.id=2d712cae6a1e48e5bb3a807436875bf2) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:10:06.145910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:10:06.147323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84cb6e-d791-40a1-b7f0-2e5598296822 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:10:06.152874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 437/905] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:10:06 2022] GET /identity/v3/role_assignments?user.id=2d712cae6a1e48e5bb3a807436875bf2&scope.project.id=7921580dc82f491e876b92878883b554&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:10:15.997401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=61 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:10:16.150443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:02.008201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5cbd6-bbb3-4c1b-a370-c088607121d5 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:02.008201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5cbd6-bbb3-4c1b-a370-c088607121d5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:02.008201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5cbd6-bbb3-4c1b-a370-c088607121d5 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:02.008201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 469/906] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:02.018069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:02.018069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:02.018069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:02.043357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:02.044806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:02.138793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 438/907] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:02.453865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5cbd6-bbb3-4c1b-a370-c088607121d5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:02.590734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5cbd6-bbb3-4c1b-a370-c088607121d5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:02.631789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:02.632474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:02.632763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:02.633077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:02.645526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:02.646999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:02.668058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:02.669859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:02.670810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:02.670810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:02.670810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:02.670810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 470/908] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:02.676791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:02.810895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb947a8-c07a-4612-99a0-66656347b28d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:02.845913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:02.852877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:02.853837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:02.854092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:02.854506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:02.855167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:02.855483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:02.857310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf258d-6908-450a-bf4b-562421d263a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:02.877727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 439/909] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:02.879421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:02.950913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:03.008939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec1bfd-0d8c-471f-924d-b5e784e81599 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:03.054992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:03.055556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:03.055886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:03.056164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:03.056890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:03.058389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89217c-45e7-45ca-8a5d-f09173eb0723 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:03.088499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 471/910] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 31 19:11:02 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:11:05.619956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a098-033d-464e-87cd-7df4088cbd0f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:05.620794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a098-033d-464e-87cd-7df4088cbd0f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:05.620794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a098-033d-464e-87cd-7df4088cbd0f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:05.622307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 440/911] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:05.629609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:05.631675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:05.631675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:05.650898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:05.652417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:05.725484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 472/912] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:06.014283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a098-033d-464e-87cd-7df4088cbd0f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:06.138843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a098-033d-464e-87cd-7df4088cbd0f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:06.181318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:06.181985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:06.182236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:06.182517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:06.195872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:11:06.201349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:06.203007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:06.203852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 441/913] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:06.209947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:06.256593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:06.326036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103015-b85c-4442-a789-cc13f6e9845b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:06.362458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:06.363254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:06.363728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:06.364171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:06.365051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:06.366151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:06.367176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:06.376983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 473/914] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:06.382917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:06.450772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:06.521304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cfd3-1042-426a-880a-cfd39fc42ec8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:06.565818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:06.566549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:06.566848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:06.567147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:06.579182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:06.580580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:06.595852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:06.596968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:06.597908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:06.597908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:06.597908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:06.597908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 442/915] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:06.603629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:06.712925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:06.716908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19f349-9560-4053-8fe2-2fe87cbbd492 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:06.755849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:06.756452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:06.756757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:06.757029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:06.757668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:06.757974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:06.759390 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:06.772194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 474/916] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:06.778074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:06.889687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90e7f-ba4a-4da9-86a1-167eb1ad0ad8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:06.891596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:06.929629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:06.930432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:06.930717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:06.930988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:06.939725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:06.941488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:11:06.953757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:06.954935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:06.956098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:06.957069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 443/917] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:06.962928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:07.081061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e020270-8f97-4d18-83bb-6db60d0a20c1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:07.121297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:07.122503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:07.122503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:07.122675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:07.123454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:07.123760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:07.125899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:07.149355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 475/918] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 19:11:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:07.150475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:07.258931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc725fc-2bc8-4af8-97d5-1d2cba24c940 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:07.299066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:07.299693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:07.299971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:07.300243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:07.311454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:07.313261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:07.328729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:07.330147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:07.331009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:07.331009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:07.331009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:07.331009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 444/919] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:07.335831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:07.356595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:07.461292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c0cf-10ca-4c0a-967f-459fb42111f9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:07.502281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:07.503168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:07.503540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:07.503913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:07.504693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:07.505092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:07.506627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:07.520398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 476/920] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:07.526244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:07.553280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:07.674829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0d10-e259-4e7e-89dc-1d8bca222e19 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:07.721429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:07.722116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:07.722457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:07.722738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:07.731202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:07.732696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:11:07.745341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:07.746608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:07.747906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 445/921] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:07.753126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:07.843523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:07.868052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f54b3e-c707-480b-98f5-9abbcdf625fb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:07.905897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:07.906504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:07.906786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:07.907057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:07.907741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:07.908045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:07.909777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24017a3f-a729-4735-82a2-13aff927ca82 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:07.924590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 477/922] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:07.930565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:08.013837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:08.043216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4da1-d932-466e-8955-de2aa430b483 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:08.079188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:08.079849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:08.080130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:08.080410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/582fecc260bd4947994cb41bc05ca111/roles/6a90cbaf7df243098e879b0a198ecf8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:08.095335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=582fecc260bd4947994cb41bc05ca111, role_id=6a90cbaf7df243098e879b0a198ecf8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:08.097042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47432c-7aa1-445d-9562-afb82a81ed53 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:08.110275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 446/923] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:11:07 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/582fecc260bd4947994cb41bc05ca111/roles/6a90cbaf7df243098e879b0a198ecf8e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:11:10.408844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead641-6390-4dcd-9a6e-69b80b0b4540 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:10.409486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead641-6390-4dcd-9a6e-69b80b0b4540 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:10.409486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead641-6390-4dcd-9a6e-69b80b0b4540 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:10.410983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 478/924] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:10.416716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:10.417161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:10.417451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:10.437896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:10.439079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:10.517597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 447/925] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 19:11:10.828057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead641-6390-4dcd-9a6e-69b80b0b4540 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:10.941940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead641-6390-4dcd-9a6e-69b80b0b4540 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:10.978616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:10.979250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:10.979583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:10.979813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:10.987350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:10.991043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:11:10.996102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:10.997079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:10.998364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 479/926] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 31 19:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:11.005312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.065928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:11.111355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0a80-ffde-4ac8-ae1c-8eb0d47e312d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:11.147580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:11.148188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:11.148504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:11.148831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:11.149496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:11.149819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:11.151182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:11.159318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 448/927] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:11.165281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.275344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f97f2-6362-4bcf-a82d-b1098da34d66 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:11.310866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:11.312064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:11.312943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:11.313276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:11.323725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:11.325137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:11.340690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:11.342028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:11.343763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:11.343763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:11.343763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:11.343763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 480/928] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:11.349090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.462845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224966f-f6b5-4f29-918a-d3f64476c60f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:11.480920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:11.502617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:11.503351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:11.503700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:11.504031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:11.504870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:11.505244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:11.507325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:11.527753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 449/929] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:11:11.532040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.587277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:11.641856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9d4e9-e652-4dff-a5ff-eaf711e48bea None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:11.675897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:11.676536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:11.676813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:11.677083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:11.684363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:11.685823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:11:11.697201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:11.698349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:11.699502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 481/930] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:11.706237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.820086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3b1b-8438-45f6-a346-815d47707689 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:11.864567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:11.864567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:11.864567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:11.864567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:11.864963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:11.864963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:11.864963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:11.882927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 450/931] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:11.889170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:11.995931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935c1d-dd37-4edf-bec5-a5a6292bec15 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:12.006576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:12.034857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:12.035471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:12.035749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:12.036135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:12.105431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:12.106894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:12.207722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 482/932] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:11:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:11:12.213455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:12.253770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:12.328146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d69f-b182-49ec-b3a7-65fae46c36d7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:12.364516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:12.365154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:12.365433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:12.365702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:12.376962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:12.378405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:12.401246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:12.402238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:12.403119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:12.403119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:12.403119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:12.403720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 451/933] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:12.410416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:12.427436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:12.532538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01f98-8c4f-479e-a0d0-1dbef5c1be99 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:12.567085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:12.567685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:12.567960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:12.568230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:12.568899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:12.569199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:12.570555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:12.582493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 483/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:12.588161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:12.676909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:12.695219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236747d-5332-487b-8885-dea11eb95e75 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:12.730598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:12.731226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:12.731504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:12.731778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:12.739191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:12.740658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:11:12.752480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:12.753384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:12.754400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 452/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:12.759548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:12.834377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:12.869936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0db6d-fabe-4576-a4b4-09e3e161160b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:12.905063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:12.906395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:12.906676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:12.906945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:12.907660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:12.907956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:12.909429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52eac-e62e-417c-b04d-b85c745ebdbf None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:12.922457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 484/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:12.928596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:13.044362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245ed1e-17a2-4afa-9d3d-ea1c13bfaa60 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:13.080966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:13.081568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:13.081844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:13.082120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:13.082833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] RBAC: Adding query filter params (role.id=6a90cbaf7df243098e879b0a198ecf8e, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=582fecc260bd4947994cb41bc05ca111) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:13.083136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:13.084651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a75e6-964a-48e5-bd99-e761bac06f63 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:13.090724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 453/937] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:11:12 2022] GET /identity/v3/role_assignments?user.id=582fecc260bd4947994cb41bc05ca111&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=6a90cbaf7df243098e879b0a198ecf8e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:15.364819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fb41-55a3-4bee-990a-dba091427bc3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:15.365376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fb41-55a3-4bee-990a-dba091427bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:15.365376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fb41-55a3-4bee-990a-dba091427bc3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:15.366705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 485/938] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:15.372405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:15.372855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:15.373227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:15.396705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:15.398278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:15.402649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:15.480883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 454/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:15.773755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64fb41-55a3-4bee-990a-dba091427bc3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:15.891387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64fb41-55a3-4bee-990a-dba091427bc3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:15.922138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:15.928964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:15.929593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:15.929867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:15.930165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:15.943327 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:11:15.949062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:15.950032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:15.950878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 486/940] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:15.958545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.068158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1344a-e2c6-48ac-be76-4b6e11f0f33e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.105466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:16.106080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:16.106355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:16.106678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:16.107392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:16.107663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:16.109560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:16.118730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 455/941] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:16.126083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.238704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc11d-2dfe-423d-b49c-6e00ccbbaa64 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.277381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:16.278096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:16.278376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:16.278646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:16.289905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:16.291368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:16.307387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:16.308389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:16.309675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:16.309675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:16.309675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:16.309675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 487/942] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:16.315061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.317992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:16.442958 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252ed9-74c9-44e1-8de8-65eba3fa41ca None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.481058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:16.481677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:16.482033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:16.482331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:16.483089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:16.483941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:16.485705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:16.498556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 456/943] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:16.504499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.551710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:16.615450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12756b-a35a-4843-b754-a1d9e98a8019 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.652569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:16.653210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:16.653508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:16.653851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:16.663116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:16.664715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:11:16.677099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:16.678232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:16.679392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 488/944] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:16.684439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.748430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:16.795662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee82ba-e8e0-4081-bde9-24e754ddc153 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.838137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:16.838954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:16.839258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:16.839565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:16.840552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:16.840996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:16.843603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:16.863054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 457/945] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 19:11:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:16.869460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:16.987686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b63ee-bcd3-44d7-9f33-b2b7a75daf85 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:16.989317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:17.025167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:17.025805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:17.026091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:17.026367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:17.038546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:17.040127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:17.055785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:17.057457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:17.058709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:17.058709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:17.058709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:17.058709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 489/946] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:17.063935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:17.177736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5896-310a-42c7-ab0a-ef386abf4014 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:17.202410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:17.218296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:17.219030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:17.219340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:17.219641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:17.220386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:17.220736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:17.222359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:17.235187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 458/947] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:17.241132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:17.357532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68e189-8bc3-4789-9bcc-15fe30008213 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:17.396886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:17.397594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:17.398049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:17.398191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:17.407029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:17.408815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:11:17.422536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:17.423757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:17.425020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:17.428991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 490/948] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 19:11:17.430266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:17.546683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330de7-8f66-4c97-bf2e-fbf79a49cd5c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:17.585783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:17.586447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:17.586665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:17.586936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:17.587671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:17.587967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:17.589458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fced4-408f-400d-a9ec-1206069af5af None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:17.602594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 459/949] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:17.609271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:17.627072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:17.720755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615deb2f-2458-441d-82d5-3868f531c2ce None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:17.758966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:17.759623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:17.759934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:17.760220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] PATH_INFO: `/v3/projects/137766e22d354d53b86e53deba57ec8f/users/582fecc260bd4947994cb41bc05ca111/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:17.762263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] RBAC: Authorizing `identity:create_grant(project_id=137766e22d354d53b86e53deba57ec8f, user_id=582fecc260bd4947994cb41bc05ca111, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:17.763693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67ff8-4149-47af-adc2-a1ef1b1e7740 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:17.779460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 491/950] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 31 19:11:17 2022] PUT /identity/v3/projects/137766e22d354d53b86e53deba57ec8f/users/582fecc260bd4947994cb41bc05ca111/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:11:20.174269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bf9a-c86c-431b-9162-ed50f820b79b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:20.174810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bf9a-c86c-431b-9162-ed50f820b79b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:20.174810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bf9a-c86c-431b-9162-ed50f820b79b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:20.176246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 460/951] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:20.181950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:20.182507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:20.182507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:20.200714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:20.202499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:20.274877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 492/952] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:20.580516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bf9a-c86c-431b-9162-ed50f820b79b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:20.626272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:20.690927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bf9a-c86c-431b-9162-ed50f820b79b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:20.726526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:20.727156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:20.727433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:20.727705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:20.738894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 19:11:20.743779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:20.744950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:20.746119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 461/953] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 31 19:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:20.751492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:20.754591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:20.854365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45aa5-4b48-4495-b997-74e7ea84fa87 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:20.890509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:20.891081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:20.891355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:20.891624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:20.892288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:20.892685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:20.894054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:20.902309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 493/954] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 31 19:11:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:20.909066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:21.020861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:21.023860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ada2bd-a455-4175-acc4-2884fbffd703 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:21.060980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:21.061932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:21.062123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:21.062393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:21.072980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:21.074447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:21.091248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:21.092659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:21.094104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:21.094104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:21.094104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:21.094104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 462/955] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:21.098765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:21.168269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:21.206380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b0a2-7ab0-4f7c-9be1-0213bf0bb5b9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:21.242490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:21.243108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:21.243381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:21.243648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:21.244303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:21.244638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:21.245999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:21.258948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 494/956] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:21.265535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:21.376285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d226f2-e877-40ed-b4c0-10c2e7514c28 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:21.412713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:21.413402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:21.413621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:21.413892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:21.422945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:21.424320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 19:11:21.436813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:21.437866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:21.438819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 463/957] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:21.443753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:21.547431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e539d5-4381-4f4f-98c6-506c605a85b9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:21.573478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:21.583254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:21.583852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:21.584131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:21.584404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:21.585162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:21.585467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:21.586912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:21.603881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 495/958] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 31 19:11:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:21.610590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:21.626378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:21.714301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777ccb3-cb2e-489e-9565-ae434073d000 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:21.747604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:21.748196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:21.748629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:21.748791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:21.816835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:21.818275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:21.831835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:21.914525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 464/959] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 31 19:11:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 19:11:21.920736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:22.015372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138aeb6c-4fb9-4d4c-8215-4f8064c496a1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:22.048321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:22.048959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:22.049239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:22.049511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:22.059052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:22.060485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 19:11:22.075075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:22.076157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 19:11:22.077756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 19:11:22.077756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 19:11:22.077756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:22.077756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 496/960] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:22.082683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:22.177468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9d2b-6df2-4012-a11d-60aecf2f822d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:22.191345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:22.212031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:22.212653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:22.212930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:22.213200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:22.213823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:22.214119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:22.215466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:22.226792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 465/961] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 31 19:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:22.232346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:22.267678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:22.332407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909eb03-300a-46a5-8b1c-efe62cd8db5d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:22.364002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:22.364631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:22.364990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:22.365259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:22.371576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:22.373050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 19:11:22.384425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:22.385458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 19:11:22.386548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 497/962] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 31 19:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:22.392428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:22.495808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a04e-2130-4efb-8028-3afb8a8b4de4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:22.528328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:22.528907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:22.529182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:22.529451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:22.530714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:22.531013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:22.532426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6832659-229e-4d5e-b62c-657c7687ba14 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:22.544150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 466/963] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 31 19:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:22.550249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:22.639674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:22.645638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff2960-3d57-485f-a73f-6bd1aee7f66f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:22.677131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:22.677709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:22.677983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:22.678251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:22.678959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] RBAC: Adding query filter params (role.id=1dfe960ebfa348b0b382df38a5b0ff55, scope.project.id=137766e22d354d53b86e53deba57ec8f, user.id=582fecc260bd4947994cb41bc05ca111) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:22.679260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:22.680685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fad-4980-4091-b596-734f0f7ddd57 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:22.686713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 498/964] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 31 19:11:22 2022] GET /identity/v3/role_assignments?user.id=582fecc260bd4947994cb41bc05ca111&scope.project.id=137766e22d354d53b86e53deba57ec8f&role.id=1dfe960ebfa348b0b382df38a5b0ff55 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:24.850554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f3de-8cfe-4590-81cd-da7de2bbf661 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:24.851060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f3de-8cfe-4590-81cd-da7de2bbf661 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:24.851147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f3de-8cfe-4590-81cd-da7de2bbf661 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:24.852448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 467/965] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:24.857546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:24.857981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:24.858213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:24.876444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:24.877654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:24.941249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 499/966] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:25.212736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f3de-8cfe-4590-81cd-da7de2bbf661 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:25.244325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:25.316536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f3de-8cfe-4590-81cd-da7de2bbf661 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:25.349658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:25.350269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:25.350545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:25.350820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:25.351418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:25.352802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:25.361532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:25.362754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:25.363824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 468/967] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:11:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:25.368622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:25.469549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:25.479118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f4f1-56ff-4584-adc5-8613662422c3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:25.510854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:25.511441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:25.511715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:25.511981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:25.512628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:25.512926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:25.514910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d281-a98a-4840-a11a-2a21550379cb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:25.519508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 500/968] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 19:11:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:25.525691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:25.619081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:25.625739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d821-94b8-496b-bd4c-10035897f5d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:25.658706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:25.659292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:25.659573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:25.659846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:25.660488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:25.660798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:25.662155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc5f73-20a8-4cd2-a3a6-35e90078a8a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:25.666490 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 469/969] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 19:11:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:27.820965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d98-5e15-4b15-84d4-0571ebbf1069 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:27.821487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d98-5e15-4b15-84d4-0571ebbf1069 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:27.821487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d98-5e15-4b15-84d4-0571ebbf1069 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:27.822812 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 501/970] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:27.828114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b913-72a9-4147-8842-ec7e984edd54 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:27.828547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b913-72a9-4147-8842-ec7e984edd54 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:27.828694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b913-72a9-4147-8842-ec7e984edd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:27.847914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3518b913-72a9-4147-8842-ec7e984edd54 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:27.849131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3518b913-72a9-4147-8842-ec7e984edd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:27.913431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 470/971] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:28.188699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994d98-5e15-4b15-84d4-0571ebbf1069 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:28.284951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994d98-5e15-4b15-84d4-0571ebbf1069 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:28.317773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:28.318352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:28.318625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:28.318893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:28.319534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:28.320899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d6fd0-2cd2-45ba-961f-34e8ac0fff18 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:28.334555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 502/972] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 31 19:11:28 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:11:30.552100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df852-2a7d-454e-bd6e-0172ad8ae320 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:30.552694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df852-2a7d-454e-bd6e-0172ad8ae320 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:30.552694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df852-2a7d-454e-bd6e-0172ad8ae320 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:30.553991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 471/973] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:30.559190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:30.559592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:30.559731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:30.578023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:30.579179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:30.588109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:30.649606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 503/974] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:30.914315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df852-2a7d-454e-bd6e-0172ad8ae320 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:31.003218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:31.013554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df852-2a7d-454e-bd6e-0172ad8ae320 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:31.047060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:31.047665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:31.047939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:31.048208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:31.048804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:31.050159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:31.058550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:31.059777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:31.061230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 472/975] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:11:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:31.065517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:31.159740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dafe1a-1368-424e-aabb-e83a6ed7e765 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:31.192767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:31.193305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:31.193583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:31.193853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:31.194474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:31.194774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:31.196119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:31.201240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 504/976] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 19:11:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:31.207245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:31.305981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa3d9c-1bbf-4aba-9149-d5c462f7061a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:31.338216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:31.338804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:31.339082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:31.339354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:31.340038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] RBAC: Adding query filter params (interface=public, service_id=272e547ac2504a0896e64f81833793f8, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:31.340342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:31.341720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70904fb-bea4-4861-a684-642c8d02156f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:31.347078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 473/977] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 31 19:11:31 2022] GET /identity/v3/endpoints?service_id=272e547ac2504a0896e64f81833793f8&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:31.352558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:31.356163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:31.463670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c9d10-0939-4e1b-a001-f281d6d7d147 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:31.497951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:31.498656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:31.498951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:31.499223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:31.499818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:31.501196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c153f3-0a01-4114-a4ed-cb1117ecf160 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:31.507751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 505/978] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 31 19:11:31 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:11:33.653872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd249-9dce-48b7-9d59-c96b52332327 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:33.654478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd249-9dce-48b7-9d59-c96b52332327 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:33.654478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd249-9dce-48b7-9d59-c96b52332327 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:33.655765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 474/979] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:11:33.661478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:33.661878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:33.662026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:33.680320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:11:33.681556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:11:33.742013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:33.747481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 506/980] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:11:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 19:11:34.028421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fd249-9dce-48b7-9d59-c96b52332327 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:34.049081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:34.129615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fd249-9dce-48b7-9d59-c96b52332327 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:34.162063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:34.162676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:34.162954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:34.163224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:34.163792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:34.165176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 19:11:34.174509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 19:11:34.175638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 19:11:34.176497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 475/981] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 31 19:11:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 19:11:34.181727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:34.276360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2079eed-6537-49a0-adea-b911ab826ed2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:34.309182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:34.309712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:34.309991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:34.310264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:34.311030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:11:34.311331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:34.312705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2149-6c48-49a9-a040-58f94e28258d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:34.317632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 507/982] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 31 19:11:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:11:34.323365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:11:34.408264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:34.427633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595cc3-d78f-4a4f-ba30-2e99a6aff124 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:11:34.463873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:11:34.464496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:11:34.464777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:11:34.465048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:11:34.465705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:11:34.467803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b823-53e3-4a90-8154-206c635bdbd5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:11:34.486553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 476/983] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:11:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:11:44.315159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=69 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:11:44.483302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:38.475700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33840-812c-4b0f-b2f7-ab614cc7edc9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:38.476183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33840-812c-4b0f-b2f7-ab614cc7edc9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:38.476283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33840-812c-4b0f-b2f7-ab614cc7edc9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:38.483604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077831bf-81b2-42b8-9f33-3a4ab6549f8c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:38.484025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077831bf-81b2-42b8-9f33-3a4ab6549f8c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:38.484158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077831bf-81b2-42b8-9f33-3a4ab6549f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:38.488979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 508/984] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:38.603211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-077831bf-81b2-42b8-9f33-3a4ab6549f8c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:38.604849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-077831bf-81b2-42b8-9f33-3a4ab6549f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:38.718065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 477/985] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:12:39.022198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:39.022503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:39.022766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:39.024257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 509/986] 10.222.0.23 () {54 vars in 965 bytes} [Mon Oct 31 19:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:39.030945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22638ab-d409-4112-8561-6257a5ec2717 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:39.031417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22638ab-d409-4112-8561-6257a5ec2717 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:39.031695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22638ab-d409-4112-8561-6257a5ec2717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:39.113744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f22638ab-d409-4112-8561-6257a5ec2717 None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:39.115145 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f22638ab-d409-4112-8561-6257a5ec2717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:39.138523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:39.205267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 478/987] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:39.215452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:39.217505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:39.346100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db641-f0fa-4453-83ab-04e94c66076d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:39.429851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:39.430598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:39.430946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:39.431285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:39.433761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:39.491685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:39.551719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:39.553286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe6da5-e8aa-4415-b2a8-9697e08b6a55 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:39.573201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 510/988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:12:42.195840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:42.196299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:42.196404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:42.197759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 479/989] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:42.203033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce7be-2d81-4103-8193-c6920b2dfa2c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:42.203417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce7be-2d81-4103-8193-c6920b2dfa2c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:42.203579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce7be-2d81-4103-8193-c6920b2dfa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:42.285649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e55ce7be-2d81-4103-8193-c6920b2dfa2c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:42.286856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e55ce7be-2d81-4103-8193-c6920b2dfa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:42.383252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 511/990] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:42.668973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:42.670502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:42.774222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fd0e3-7f64-41a6-8905-2d9a49c88b64 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:42.846934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:42.849285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:42.850061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:42.850385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:42.850795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:42.852641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:42.960598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:42.962031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab036c8c-8fc6-4143-abff-b70b13afc435 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:42.981015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 480/991] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:12:45.434019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:45.434579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:45.434579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:45.435885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 512/992] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:45.441065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7a2c-1c73-483c-a8ca-593b3629eeb7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:45.441482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7a2c-1c73-483c-a8ca-593b3629eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:45.441598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7a2c-1c73-483c-a8ca-593b3629eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:45.507498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-497b7a2c-1c73-483c-a8ca-593b3629eeb7 None None] MFA Rules not processed for user `25ec2169aa074182a0582fc390a13413`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:45.508721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-497b7a2c-1c73-483c-a8ca-593b3629eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:45.560832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:45.607007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 481/993] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:45.899596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:45.901159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:45.912134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:46.006199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc0207-0309-4b8d-8d71-7f514a012bdc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:46.079893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:46.080411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:46.080721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:46.080995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:46.082568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:46.142740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:46.192817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:46.194237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffd0a3-0680-4288-a277-14a58363bda2 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:46.211558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 513/994] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:12:48.869425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585831-d5e1-47e2-bdc0-ffe8e174d702 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:48.870014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585831-d5e1-47e2-bdc0-ffe8e174d702 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:48.870014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585831-d5e1-47e2-bdc0-ffe8e174d702 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:48.871878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 482/995] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:48.876975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ddbc-0faa-4a39-9dd4-6bef542e1994 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:48.877381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ddbc-0faa-4a39-9dd4-6bef542e1994 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:48.877500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ddbc-0faa-4a39-9dd4-6bef542e1994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:48.941990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7714ddbc-0faa-4a39-9dd4-6bef542e1994 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:48.943171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7714ddbc-0faa-4a39-9dd4-6bef542e1994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:49.035973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 514/996] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:49.336248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:49.336560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:49.336834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:49.338178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 483/997] 10.222.0.23 () {54 vars in 965 bytes} [Mon Oct 31 19:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:49.345095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6f49-8467-4fb9-9658-258bfdda64ac None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:49.345382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6f49-8467-4fb9-9658-258bfdda64ac None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:49.345657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6f49-8467-4fb9-9658-258bfdda64ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:49.367192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:49.420272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d52f6f49-8467-4fb9-9658-258bfdda64ac None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:49.421487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d52f6f49-8467-4fb9-9658-258bfdda64ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:49.496114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 515/998] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Oct 31 19:12:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:49.505064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:49.506583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:49.609350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b2c0c-ee90-424a-afbf-e043f0cb478f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:49.684240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:49.684875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:49.685152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:49.685421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:49.686987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:49.693897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:49.795331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:49.796822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197fc57-42cc-4ea4-958b-d76f73d248e0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:49.814462 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 484/999] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:12:53.069614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:53.070138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:53.070138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:53.075802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 516/1000] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:53.077500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c12d4-46a9-4ff8-a005-b1bac7506618 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:53.078475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c12d4-46a9-4ff8-a005-b1bac7506618 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:53.079043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c12d4-46a9-4ff8-a005-b1bac7506618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:53.168414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-107c12d4-46a9-4ff8-a005-b1bac7506618 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:53.169662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-107c12d4-46a9-4ff8-a005-b1bac7506618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:53.237945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:53.286440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 485/1001] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:53.572372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:53.574062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:53.676118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478d09-9737-407b-b7ea-904afcd19e1b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:53.689503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:53.751303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:53.751923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:53.752200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:53.752496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:53.754208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:53.865309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:53.866733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436616ac-2e2b-4eac-a127-4a115f0fd1a5 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:53.885688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 517/1002] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:12:56.104866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:56.104866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:56.105452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:56.106558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 486/1003] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:56.111625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f481-ca9e-41d2-8e15-e00062a97f1b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:56.112025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f481-ca9e-41d2-8e15-e00062a97f1b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:56.112259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9f481-ca9e-41d2-8e15-e00062a97f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:56.159641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:56.184925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-efe9f481-ca9e-41d2-8e15-e00062a97f1b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:56.186257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-efe9f481-ca9e-41d2-8e15-e00062a97f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:56.287905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 518/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:56.573126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:56.575414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:56.679317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d1d2-62b4-4ff0-93f5-c8039b6bec42 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:56.757072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:56.757673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:56.757951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:56.758218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:56.759774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:56.779476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:56.874716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:56.876139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab94621-8285-4795-808d-3507b977e968 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:56.894524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 487/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:12:59.136370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:59.136946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:59.136946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:59.138244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 519/1006] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:12:59.143536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b2a-18b3-459d-bdcd-7296100215f9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:59.143966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b2a-18b3-459d-bdcd-7296100215f9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:59.144091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b2a-18b3-459d-bdcd-7296100215f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:59.211811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cc973b2a-18b3-459d-bdcd-7296100215f9 None None] MFA Rules not processed for user `25ec2169aa074182a0582fc390a13413`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:12:59.213054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc973b2a-18b3-459d-bdcd-7296100215f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:59.279405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:59.313450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 488/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:12:59.597561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:12:59.599095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:59.702954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657bfcf-54ac-499a-84f9-78dae0d21087 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:12:59.723258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:12:59.781553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:12:59.782171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:12:59.782431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:12:59.782698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:12:59.784273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:12:59.893050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:12:59.894399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35af3c-4270-49a5-9b13-94edc132fb7a service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:12:59.913023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 520/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:02.317075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:02.317630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:02.317630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:02.318960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 489/1009] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:02.324384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c2b8-139a-4276-ab97-d770497c19a6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:02.324822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c2b8-139a-4276-ab97-d770497c19a6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:02.324972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c2b8-139a-4276-ab97-d770497c19a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:02.387437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:02.390462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a1b2c2b8-139a-4276-ab97-d770497c19a6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:02.392063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a1b2c2b8-139a-4276-ab97-d770497c19a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:02.488067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 521/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:02.772401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:02.773978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:02.876905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb099b7-06bb-491a-9c5a-f432c25ef20d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:02.951250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:02.951857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:02.952140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:02.952414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:02.954048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:02.981180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:03.062562 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:03.063912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4135d33-3e72-49ed-a24e-a67ca4fc1377 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:03.081926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 490/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:05.274883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:05.275430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:05.275430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:05.276843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 522/1012] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:05.282020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d7b3-1f33-447f-bf59-74d543f353c7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:05.282410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d7b3-1f33-447f-bf59-74d543f353c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:05.282636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d7b3-1f33-447f-bf59-74d543f353c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:05.350642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d0e7d7b3-1f33-447f-bf59-74d543f353c7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:05.351835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d0e7d7b3-1f33-447f-bf59-74d543f353c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:05.428247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:05.451575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 491/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:05.736296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:05.737857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:05.842165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925a4ae-b66f-445f-85a7-0e66a5b2a00e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:05.869638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:05.914488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:05.915113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:05.915388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:05.915656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:05.917310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:06.023043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:06.024381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774834-dfa8-4eb2-bf56-0318018b378f service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:06.042466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 523/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:08.530680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:08.531240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:08.531240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:08.532572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 492/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:08.537616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b16b-b598-476c-bb2f-c03f35e45c14 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:08.538031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b16b-b598-476c-bb2f-c03f35e45c14 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:08.538174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4b16b-b598-476c-bb2f-c03f35e45c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:08.606344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-caa4b16b-b598-476c-bb2f-c03f35e45c14 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:08.607552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-caa4b16b-b598-476c-bb2f-c03f35e45c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:08.615650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:08.704106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 524/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:08.986926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:08.988485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:09.091815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03a42e-b4c1-4dda-88e7-30fc03bead65 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:09.164443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:09.165085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:09.165368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:09.165643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:09.168225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:09.203666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:09.277295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:09.278661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f31e-ac66-4ed9-a108-4e26552b5024 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:09.297541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 493/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:13.413911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:13.414440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:13.414440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:13.415778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 525/1018] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:13.422095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af4c9c-9622-4393-b8bf-79ed4bd7857f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:13.422494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af4c9c-9622-4393-b8bf-79ed4bd7857f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:13.422637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af4c9c-9622-4393-b8bf-79ed4bd7857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:13.489887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-97af4c9c-9622-4393-b8bf-79ed4bd7857f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:13.491008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97af4c9c-9622-4393-b8bf-79ed4bd7857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:13.581303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:13.594094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 494/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:13.877669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:13.879188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:13.981747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575aafb-a4b5-46f8-9659-d909e1a85cd4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:14.021316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:14.057321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:14.057836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:14.058116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:14.058388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:14.059963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:14.167360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:14.169087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2843a-930d-4752-97d4-952edd51db45 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:14.186930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 526/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:17.019114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:17.019638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:17.019725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:17.021097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 495/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:17.026658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816257-dd28-42d8-b2fa-47fe09931a6c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:17.027078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816257-dd28-42d8-b2fa-47fe09931a6c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:17.027209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816257-dd28-42d8-b2fa-47fe09931a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:17.093093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-57816257-dd28-42d8-b2fa-47fe09931a6c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:17.094255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-57816257-dd28-42d8-b2fa-47fe09931a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:17.112320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:17.191621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 527/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:17.479161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:17.480775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:17.590429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650f202-f851-4878-8650-cd8b1337b5f1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:17.665288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:17.665932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:17.667135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:17.667262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:17.669085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:17.714436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:17.788513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:17.789899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ca41-3a71-4499-8569-707a5c377076 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:17.810796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 496/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:22.162634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:22.163165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:22.163165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:22.164678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 528/1024] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:22.170958 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9afa7c-5426-41dc-9125-54930aa62dea None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:22.171377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9afa7c-5426-41dc-9125-54930aa62dea None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:22.171510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9afa7c-5426-41dc-9125-54930aa62dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:22.242906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-df9afa7c-5426-41dc-9125-54930aa62dea None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:22.244372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df9afa7c-5426-41dc-9125-54930aa62dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:22.345421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:22.348001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 497/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:22.627550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:22.629128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:22.737590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e139f9-7f3f-4821-a272-a7a6acc20421 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:22.788711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:22.815345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:22.815873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:22.816144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:22.816429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:22.818011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:22.924544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:22.925973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53661-893c-498f-ad41-e2d261e08293 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:22.944554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 529/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:27.904217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4fc4d-054b-44ce-9e70-11a61a2a08d5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:27.904752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4fc4d-054b-44ce-9e70-11a61a2a08d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:27.905025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4fc4d-054b-44ce-9e70-11a61a2a08d5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:27.906755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 498/1027] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:27.911795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ae2-696b-4cbf-ab21-a67a0ed1f417 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:27.912190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ae2-696b-4cbf-ab21-a67a0ed1f417 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:27.912580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ae2-696b-4cbf-ab21-a67a0ed1f417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:28.061150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-aeb21ae2-696b-4cbf-ab21-a67a0ed1f417 None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:28.062448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aeb21ae2-696b-4cbf-ab21-a67a0ed1f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:28.082039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:28.186711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 530/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:13:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:32.195004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21031-b88e-4313-beb5-6b6ae0bf7da0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:32.195880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21031-b88e-4313-beb5-6b6ae0bf7da0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:32.196155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae21031-b88e-4313-beb5-6b6ae0bf7da0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:32.197803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 499/1029] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:32.202686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008841-a134-4669-b36c-bd6df5da3fcf None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:32.203119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008841-a134-4669-b36c-bd6df5da3fcf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:32.203239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008841-a134-4669-b36c-bd6df5da3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:32.282739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7f008841-a134-4669-b36c-bd6df5da3fcf None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:32.283938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7f008841-a134-4669-b36c-bd6df5da3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:32.360701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:32.401371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 531/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:33.850129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446e6e-71be-48ef-b396-81c6e6635fa4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:33.850648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446e6e-71be-48ef-b396-81c6e6635fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:33.850839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446e6e-71be-48ef-b396-81c6e6635fa4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:33.852252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 500/1031] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:33.858080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5156-60bd-447b-86c3-895ffe6cf145 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:33.858496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5156-60bd-447b-86c3-895ffe6cf145 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:33.858660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c5156-60bd-447b-86c3-895ffe6cf145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:33.936251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0e6c5156-60bd-447b-86c3-895ffe6cf145 None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:33.937403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0e6c5156-60bd-447b-86c3-895ffe6cf145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:34.046533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 532/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:13:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:37.744050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ad05-e18a-48d4-a523-c7fec5f13260 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:37.744953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ad05-e18a-48d4-a523-c7fec5f13260 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:37.745229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ad05-e18a-48d4-a523-c7fec5f13260 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:37.750779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 501/1033] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:37.752737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4ce6-cffb-4512-ba44-38ebc37b723d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:37.753575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4ce6-cffb-4512-ba44-38ebc37b723d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:37.754100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4ce6-cffb-4512-ba44-38ebc37b723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:37.802879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:37.838972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5a8f4ce6-cffb-4512-ba44-38ebc37b723d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:37.840067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5a8f4ce6-cffb-4512-ba44-38ebc37b723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:37.948538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 533/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:13:38.249981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:38.250657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:38.251120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:38.253123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 502/1035] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:38.262752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc89d5-af65-411d-9299-e10937db939c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:38.263347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc89d5-af65-411d-9299-e10937db939c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:38.263939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc89d5-af65-411d-9299-e10937db939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:38.345341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c5fc89d5-af65-411d-9299-e10937db939c None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:38.346528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c5fc89d5-af65-411d-9299-e10937db939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:38.398575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:38.484279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 534/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:13:38.492012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:38.493689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:38.656082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb50db6-7c59-4529-a7fb-458a94e45509 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:38.733668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:38.776028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:38.777329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:38.777762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:38.778198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:38.780560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:38.881148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:38.882732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599fe3e-476d-48cf-9837-10f538ae519a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:38.902231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 503/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:41.457586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:41.458026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:41.458311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:41.460052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 535/1038] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:41.465045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d237-67db-4dd2-afeb-be6674cb0c09 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:41.465738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d237-67db-4dd2-afeb-be6674cb0c09 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:41.465738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d237-67db-4dd2-afeb-be6674cb0c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:41.537427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b89d237-67db-4dd2-afeb-be6674cb0c09 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:41.538652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b89d237-67db-4dd2-afeb-be6674cb0c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:41.581086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:41.652588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 504/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:41.938522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:41.940108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:42.120876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3646b-f177-4da8-b0ef-c7f3f9c220b0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:42.132835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:42.250595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:42.251208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:42.251489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:42.251767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:42.253412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:42.348145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:42.349757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebfbec-c29f-4893-ba10-a4323e9d6098 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:42.369039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 536/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:44.861777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345499c-acec-43e5-bc33-331bd386ec49 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:44.861777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345499c-acec-43e5-bc33-331bd386ec49 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:44.861777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345499c-acec-43e5-bc33-331bd386ec49 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:44.863409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 505/1041] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:44.868065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac8b1-0445-4e78-8deb-b5c7f122e1c1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:44.869524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac8b1-0445-4e78-8deb-b5c7f122e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:44.869524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac8b1-0445-4e78-8deb-b5c7f122e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:44.885138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:44.942320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ab3ac8b1-0445-4e78-8deb-b5c7f122e1c1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:44.943682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ab3ac8b1-0445-4e78-8deb-b5c7f122e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:45.050252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 537/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:45.350387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:45.350674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:45.351143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:45.353062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 506/1043] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:45.359047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf47b-437b-4f3c-bbed-e487eafe508f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:45.359445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf47b-437b-4f3c-bbed-e487eafe508f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:45.360049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf47b-437b-4f3c-bbed-e487eafe508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:45.441316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-223cf47b-437b-4f3c-bbed-e487eafe508f None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:45.442739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-223cf47b-437b-4f3c-bbed-e487eafe508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:45.480189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:45.567631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 538/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:45.576664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:45.578187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:45.739778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293905-7ad6-435d-b2de-f2cba12f507a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:45.762723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:45.875867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:45.876601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:45.876839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:45.877046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:45.878637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:45.982900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:45.984536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6693e-6839-4587-8b8a-b1b71fbfe305 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:46.003670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 507/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:46.060802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e04c6-04fe-4912-b5aa-7c0da16cef6d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:46.061659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e04c6-04fe-4912-b5aa-7c0da16cef6d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:46.061995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e04c6-04fe-4912-b5aa-7c0da16cef6d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:46.063683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 539/1046] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:46.068870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8a79-ead7-4968-a799-8bcb483577b7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:46.069159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8a79-ead7-4968-a799-8bcb483577b7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:46.069434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8a79-ead7-4968-a799-8bcb483577b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:46.110713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:46.156805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-55bb8a79-ead7-4968-a799-8bcb483577b7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:46.158215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-55bb8a79-ead7-4968-a799-8bcb483577b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:46.287603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 508/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:46.626905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:46.627473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:46.627473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:46.629104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 540/1048] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 31 19:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:46.634564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a79e56-9427-4414-a3fa-1e3194a76166 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:46.634926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a79e56-9427-4414-a3fa-1e3194a76166 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:46.635277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a79e56-9427-4414-a3fa-1e3194a76166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:46.721282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-89a79e56-9427-4414-a3fa-1e3194a76166 None None] MFA Rules not processed for user `1b15ab0375434a93834a3591da357114`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:46.722582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89a79e56-9427-4414-a3fa-1e3194a76166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:46.776133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:46.811187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 509/1049] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 31 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:46.820195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:46.822669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:46.932007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3f165-8e6e-4230-9a19-77e4a7840c3d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:46.975495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:47.017965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:47.018843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:47.019032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:47.019308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:47.021262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:47.156048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:47.157400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271221b4-f11f-48b0-b541-8415d821da39 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:47.180293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 541/1050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:13:48.297000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:48.297504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:48.297584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:48.298898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 510/1051] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:48.304661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2586-7ce9-4365-92a2-05c51e6458ab None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:48.305050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2586-7ce9-4365-92a2-05c51e6458ab None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:48.305236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2586-7ce9-4365-92a2-05c51e6458ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:48.370103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5ceb2586-7ce9-4365-92a2-05c51e6458ab None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:48.372253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5ceb2586-7ce9-4365-92a2-05c51e6458ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:48.392123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:48.473868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 542/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:48.768329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:48.770107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:48.927638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5b147-b1a9-4ea6-a7bf-d90e47da283e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:48.985332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:49.049997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:49.050606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:49.051471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:49.051471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:49.052889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:49.149726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:49.151862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382da34c-d801-4b24-a9f9-f7324014c7a3 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:49.172327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 511/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:51.408829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:51.409378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:51.409668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:51.415131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 543/1054] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:51.416732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579fa24-32c4-4173-bf99-0dea9699080f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:51.417183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579fa24-32c4-4173-bf99-0dea9699080f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:51.417363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579fa24-32c4-4173-bf99-0dea9699080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:51.493894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9579fa24-32c4-4173-bf99-0dea9699080f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:51.495199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9579fa24-32c4-4173-bf99-0dea9699080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:51.503503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:51.608501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 512/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:51.904111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:51.905857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:52.062259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7f62-4607-4493-9348-6796ee4f91e1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:52.066368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:52.185137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:52.185936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:52.186316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:52.186788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:52.188379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:52.287041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:52.289206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0027a62-79ec-4ef8-b164-f4fddb39055c service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:52.309630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 544/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:54.611611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:54.612130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:54.612211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:54.613566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 513/1057] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:54.619250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a4d-ed54-4aad-8ce6-95413eded60b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:54.619734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a4d-ed54-4aad-8ce6-95413eded60b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:54.619826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a4d-ed54-4aad-8ce6-95413eded60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:54.632653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:54.692038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-91015a4d-ed54-4aad-8ce6-95413eded60b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:54.693273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-91015a4d-ed54-4aad-8ce6-95413eded60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:54.816451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 545/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:55.147636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:55.149841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:55.300268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:55.312890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390795d-b4ed-4cb9-bfa7-df0de19b5659 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:55.454124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:55.454748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:55.455040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:55.455346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:55.456981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:55.558479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:55.560144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b91f-056f-49ec-a6da-12666794bb3f service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:55.571265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:55.581415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 514/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:13:57.809423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:57.809997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:57.809997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:57.811309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 546/1060] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:13:57.816753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228da6-d89f-456f-b02e-033e30c9576a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:57.817516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228da6-d89f-456f-b02e-033e30c9576a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:57.817516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228da6-d89f-456f-b02e-033e30c9576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:57.892863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d1228da6-d89f-456f-b02e-033e30c9576a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:13:57.894074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1228da6-d89f-456f-b02e-033e30c9576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:58.034502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 515/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:13:58.334174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:13:58.335774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:58.437043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:58.511593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e0aa3-907a-4461-b07d-305727a04c70 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:13:58.648827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:13:58.649646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:13:58.649999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:13:58.650352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:13:58.652363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:13:58.725747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:58.773067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:13:58.774913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c6ac3-d94f-4bcf-832a-4f74e15da614 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:13:58.795830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 547/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:01.252998 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:01.253594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:01.253594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:01.254909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 516/1063] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:01.261119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6255-9e74-462a-a772-ece7ee321e21 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:01.261571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6255-9e74-462a-a772-ece7ee321e21 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:01.261671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6255-9e74-462a-a772-ece7ee321e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:01.327400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c55c6255-9e74-462a-a772-ece7ee321e21 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:01.328617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c55c6255-9e74-462a-a772-ece7ee321e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:01.424670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 548/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:01.712977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:01.714497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:01.792330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:01.863269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3df3f-5818-47fd-9d83-b75a856522be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:01.976085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:01.976724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:01.977799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:01.978228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:01.979812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:02.019348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:02.073340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:02.074970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c441-694b-4c0a-beba-b9f340f676a4 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:02.092892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 517/1065] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:02.917319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8039-454c-4d45-a940-72674b5efda6 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:02.918136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8039-454c-4d45-a940-72674b5efda6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:02.918136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8039-454c-4d45-a940-72674b5efda6 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:02.919458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 549/1066] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:02.924766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febea11-a783-4bf0-bcb5-b6f4b3e38464 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:02.925220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febea11-a783-4bf0-bcb5-b6f4b3e38464 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:02.925323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febea11-a783-4bf0-bcb5-b6f4b3e38464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:02.995040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3febea11-a783-4bf0-bcb5-b6f4b3e38464 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:02.996607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3febea11-a783-4bf0-bcb5-b6f4b3e38464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:03.096956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 518/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:03.413628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:03.413951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:03.414187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:03.415804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 550/1068] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 31 19:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:03.421246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61bef-5087-45a1-95f7-2f061e568bd0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:03.421607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61bef-5087-45a1-95f7-2f061e568bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:03.421973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61bef-5087-45a1-95f7-2f061e568bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:03.440177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:03.523686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14f61bef-5087-45a1-95f7-2f061e568bd0 None None] MFA Rules not processed for user `03e8c5ebd3eb4d1cab97c3d1eaff3f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:03.525874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14f61bef-5087-45a1-95f7-2f061e568bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:03.627071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:03.628420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:03.630985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 519/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 19:14:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:03.667999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:03.746188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853479d-4ea6-4182-82a6-d0b876cf947f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:03.824936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:03.825537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:03.825821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:03.826093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:03.827666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:03.906287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:03.938888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:03.940317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43dcec-4c04-4862-bf28-cc9f1deef670 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:03.958175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 551/1070] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:04.295835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5f6a-7f2c-49c5-ba5d-0a209302ec56 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:04.296406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5f6a-7f2c-49c5-ba5d-0a209302ec56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:04.296406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf5f6a-7f2c-49c5-ba5d-0a209302ec56 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:04.297879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 520/1071] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:04.303349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:04.303638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:04.303916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:04.377540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:04.378738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:04.482305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 552/1072] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:04.713076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e0d2-280f-49cf-b382-a9c6e44c4157 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:04.713357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e0d2-280f-49cf-b382-a9c6e44c4157 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:04.713628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e0d2-280f-49cf-b382-a9c6e44c4157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:04.778913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:04.780095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:04.783568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b760e0d2-280f-49cf-b382-a9c6e44c4157 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:04.784762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b760e0d2-280f-49cf-b382-a9c6e44c4157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:04.822558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:04.843664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:04.875751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 521/1073] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:04.897246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754c1a6-e597-4be0-913e-2dfe8f3f2a2d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:04.924433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6cee-d6eb-4039-809c-f3c06f8cf9c5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:04.924760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6cee-d6eb-4039-809c-f3c06f8cf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:04.925075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6cee-d6eb-4039-809c-f3c06f8cf9c5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:04.926423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 522/1074] 10.222.0.23 () {54 vars in 943 bytes} [Mon Oct 31 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:14:04.932359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:04.932726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:04.933067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:05.012728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] MFA Rules not processed for user `23a46239196c40d1a1529909da19d0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:05.013580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:05.014117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:05.014273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:05.014451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:05.014719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:05.016272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:05.053006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:05.109785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:05.111373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215cdfb-ef13-4839-9c55-67db5e419764 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:05.124997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 523/1075] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Oct 31 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:14:05.129798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 553/1076] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:14:05.134954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:05.144824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b53a-dee5-4499-b8c8-799594732551 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:05.173444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:05.262151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:05.262771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:05.263046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:05.263316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:05.265128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:05.361761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:05.363362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9db06-bb15-4747-901e-b94012a263f7 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:05.372555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 524/1077] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:14:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:14:07.348770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:07.349383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:07.349383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:07.350653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 554/1078] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:07.356569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e9d7-ff6d-488e-afc2-c1291b4fffdb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:07.357031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e9d7-ff6d-488e-afc2-c1291b4fffdb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:07.357122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e9d7-ff6d-488e-afc2-c1291b4fffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:07.433638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c023e9d7-ff6d-488e-afc2-c1291b4fffdb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:07.434843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c023e9d7-ff6d-488e-afc2-c1291b4fffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:07.443838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:07.547213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 525/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:07.841633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:07.843136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:08.013890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d111-aebf-4ce2-933b-836585c4c272 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:08.027365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:08.145652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:08.146202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:08.146480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:08.146751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:08.148356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:08.248283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:08.249996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa43a-fba3-4451-8aa0-503c051cf890 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:08.269838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 555/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:10.515851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:10.515851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:10.515851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:10.522234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1cbc-d391-48ec-b721-773ac26b308d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:10.522787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1cbc-d391-48ec-b721-773ac26b308d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:10.522787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1cbc-d391-48ec-b721-773ac26b308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:10.528442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 526/1081] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:10.549571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:10.606263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-aa8e1cbc-d391-48ec-b721-773ac26b308d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:10.607731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aa8e1cbc-d391-48ec-b721-773ac26b308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:10.723709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 556/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:14:11.013918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:11.015548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:11.163385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:11.175002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0c78-9f9e-436f-93f7-43f2cbf4757c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:11.301227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:11.301741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:11.302020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:11.302290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:11.303872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:11.403328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:11.405332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cacf-fb98-4d35-bdad-e9a70c998b55 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:11.417128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:11.426155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 527/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:13.770816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:13.771381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:13.771381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:13.772738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 557/1084] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:13.779242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1362-3780-4a56-95d5-d21ceea2770d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:13.780212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1362-3780-4a56-95d5-d21ceea2770d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:13.780746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1362-3780-4a56-95d5-d21ceea2770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:13.853886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-54af1362-3780-4a56-95d5-d21ceea2770d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:13.855220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-54af1362-3780-4a56-95d5-d21ceea2770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:13.967119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 528/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:14.261560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:14.263070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:14.366148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:14.427534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cedb6-e1ea-4ef8-8da4-10e998c76b9d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:14.551510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:14.552027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:14.552308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:14.552625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:14.554226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:14.626275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:14.662632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:14.665076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8657bc-46f4-4ea9-acd8-9fb5ae2d3386 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:14.687969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 558/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:23.965766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=67 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:24.684028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=20 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:28.234320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9ed7-2c30-4888-9810-6fd045961265 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:28.234875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9ed7-2c30-4888-9810-6fd045961265 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:28.234875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9ed7-2c30-4888-9810-6fd045961265 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:28.236195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 529/1087] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 31 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:28.241527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639595e-a909-441c-bb83-3fb0f85b9f2d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:28.242477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639595e-a909-441c-bb83-3fb0f85b9f2d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:28.242615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639595e-a909-441c-bb83-3fb0f85b9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:28.316912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3639595e-a909-441c-bb83-3fb0f85b9f2d None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:28.318099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3639595e-a909-441c-bb83-3fb0f85b9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:28.423615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 559/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 19:14:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:28.438144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ec35-43e2-4d53-9746-56c5f60f2743 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:28.438424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ec35-43e2-4d53-9746-56c5f60f2743 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:28.438692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ec35-43e2-4d53-9746-56c5f60f2743 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:28.439990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 530/1089] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 31 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:28.444450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6733d-f34c-43e7-9974-08a0a24b709f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:28.444758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6733d-f34c-43e7-9974-08a0a24b709f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:28.445036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6733d-f34c-43e7-9974-08a0a24b709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:28.516947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:28.520191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a2e6733d-f34c-43e7-9974-08a0a24b709f None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:28.521975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a2e6733d-f34c-43e7-9974-08a0a24b709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:28.635809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 560/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 19:14:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:31.228884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:31.229433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:31.229433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:31.230745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 531/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:31.235967 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3041c-2f5b-4d05-9113-f5c10acf747f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:31.236376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3041c-2f5b-4d05-9113-f5c10acf747f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:31.236554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3041c-2f5b-4d05-9113-f5c10acf747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:31.303061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-56e3041c-2f5b-4d05-9113-f5c10acf747f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:31.304358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56e3041c-2f5b-4d05-9113-f5c10acf747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:31.357484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:31.398169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 561/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:31.689254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:31.690963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:31.837518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e761d-6f7f-4f7b-b302-14f983bf642c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:31.909507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:31.949606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:31.950162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:31.950437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:31.950703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:31.952276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:32.041184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:32.043027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81812-2f81-48ca-805b-8762dceec143 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:32.060475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 532/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:33.195704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af38f-a603-4869-a099-5164765e5b8e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:33.196238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af38f-a603-4869-a099-5164765e5b8e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:33.196238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af38f-a603-4869-a099-5164765e5b8e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:33.197487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 562/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:33.202533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67829-75b0-4917-8958-3c43a264d601 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:33.202954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67829-75b0-4917-8958-3c43a264d601 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:33.203070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c67829-75b0-4917-8958-3c43a264d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:33.281593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e1c67829-75b0-4917-8958-3c43a264d601 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:33.282775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e1c67829-75b0-4917-8958-3c43a264d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:33.309938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:33.379982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 533/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:33.534037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af38f-a603-4869-a099-5164765e5b8e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:33.535583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-195af38f-a603-4869-a099-5164765e5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:33.683042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af38f-a603-4869-a099-5164765e5b8e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:33.722376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:33.796038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:33.796613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:33.796892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:33.797160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:33.798731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:33.886796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:33.888362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350edd8-9dfa-4a49-b92d-8a254c7da92b service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:33.906992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 563/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:35.022151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:35.023258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:35.023361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:35.024782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 534/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:35.029661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b59a-7050-404c-9ba6-b84ed9c8aa57 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:35.030095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b59a-7050-404c-9ba6-b84ed9c8aa57 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:35.030191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b59a-7050-404c-9ba6-b84ed9c8aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:35.084053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:35.106202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6668b59a-7050-404c-9ba6-b84ed9c8aa57 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:35.107389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6668b59a-7050-404c-9ba6-b84ed9c8aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:35.201265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 564/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:35.361118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:35.362722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:35.509056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012fab6-65a3-4cc5-8d31-21c240cab127 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:35.521044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:35.621443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:35.621960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:35.622233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:35.622498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:35.624107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:35.712360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:35.713961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d5ec-e3d3-4459-b51e-87af1f6ee27a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:35.732408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 535/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:36.825658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:36.826162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:36.826257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:36.827531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 565/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:36.832584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ce7d-44d7-494e-b2a2-c9b53790c3aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:36.833015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ce7d-44d7-494e-b2a2-c9b53790c3aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:36.833015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ce7d-44d7-494e-b2a2-c9b53790c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:36.853446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:36.911632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a546ce7d-44d7-494e-b2a2-c9b53790c3aa None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:36.912871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a546ce7d-44d7-494e-b2a2-c9b53790c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:37.009759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 536/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:37.164793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:37.166223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:37.274470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:37.310550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140700-ee14-4b2b-b27c-bac1f978e901 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:37.419636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:37.420145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:37.420422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:37.420726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:37.422315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:37.497040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:37.510261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:37.511841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda12b5-56d6-4c68-8b6c-eabbc7261b24 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:37.529337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 566/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:38.624873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:38.625338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:38.625450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:38.626736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 537/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:38.631477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacbb4-acb5-490b-8943-49f032e857f2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:38.631914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacbb4-acb5-490b-8943-49f032e857f2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:38.632218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacbb4-acb5-490b-8943-49f032e857f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:38.706300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-53dacbb4-acb5-490b-8943-49f032e857f2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:38.707501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-53dacbb4-acb5-490b-8943-49f032e857f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:38.807530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 567/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:38.956946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:38.958484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:39.043424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:39.105831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333fef1-545d-448b-b6ee-179d421d01c6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:39.217459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:39.218066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:39.218345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:39.218620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:39.220217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:39.269397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:39.311621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:39.313176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec99a54-bf6b-44dd-9ba4-6de6a3ebfbb2 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:39.331200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 538/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:40.373529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:40.374019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:40.374125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:40.375440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 568/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:40.380183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc17bb-ed51-4a67-8734-f35bbbb2592f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:40.380654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc17bb-ed51-4a67-8734-f35bbbb2592f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:40.380751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc17bb-ed51-4a67-8734-f35bbbb2592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:40.476332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fbbc17bb-ed51-4a67-8734-f35bbbb2592f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:40.478353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fbbc17bb-ed51-4a67-8734-f35bbbb2592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:40.595825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 539/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:40.764631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:40.766603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:40.824806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:40.943414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28097520-9774-41fa-bc2b-d53903255fcb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:41.067037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:41.067637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:41.067916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:41.068190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:41.070385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:41.079671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:41.165663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:41.167242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85965c-638a-4a09-ab2e-3bc770f55727 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:41.185431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 569/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:42.228026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:42.228614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:42.228614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:42.229954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 540/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:42.234837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8fdd-cf3b-4039-8fa1-9b7774b17cd3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:42.235250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8fdd-cf3b-4039-8fa1-9b7774b17cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:42.235382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8fdd-cf3b-4039-8fa1-9b7774b17cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:42.310639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d59b8fdd-cf3b-4039-8fa1-9b7774b17cd3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:42.311822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d59b8fdd-cf3b-4039-8fa1-9b7774b17cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:42.378474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:42.407844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 570/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:42.559477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:42.561026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:42.578773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:42.708708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167cf4-3926-4262-bc86-4e7ce701f91a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:42.799385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:42.827104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:42.827709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:42.827990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:42.828263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:42.829896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:42.921390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:42.922963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaa6f-64f6-4753-ae63-d0c8664393ee service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:42.941039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 541/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:43.991834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:43.992395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:43.992395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:43.993766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 571/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:43.998521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba821ea1-e166-4d09-be7f-5d411bf98280 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:43.998973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba821ea1-e166-4d09-be7f-5d411bf98280 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:43.999144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba821ea1-e166-4d09-be7f-5d411bf98280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:44.077997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba821ea1-e166-4d09-be7f-5d411bf98280 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:44.079200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba821ea1-e166-4d09-be7f-5d411bf98280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:44.122988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:44.180221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 542/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:44.330120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:44.331578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:44.479771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5389cc-eed5-4df7-92c9-7851fcb5f124 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:44.533195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:44.591213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:44.591732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:44.592027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:44.592295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:44.593923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:44.682352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:44.684403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dfe2e-13c1-4991-a5ba-fff7eeda8b48 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:44.702592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 572/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:45.748586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:45.749162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:45.749162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:45.750454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 543/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:45.755363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554fd9-0573-4c1a-a2c5-6158d42006df None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:45.755814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554fd9-0573-4c1a-a2c5-6158d42006df None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:45.755910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63554fd9-0573-4c1a-a2c5-6158d42006df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:45.832678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-63554fd9-0573-4c1a-a2c5-6158d42006df None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:45.833863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-63554fd9-0573-4c1a-a2c5-6158d42006df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:45.836401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:45.930534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 573/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:46.078547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:46.080044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:46.224010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8114-d4db-4545-9940-98dcac6449d3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:46.251572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:46.338420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:46.338942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:46.339220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:46.339491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:46.341100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:46.431159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:46.432777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d85c-86e8-4d9a-b154-3b378fac3745 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:46.450793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 544/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:48.526407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:48.526877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:48.526996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:48.528292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 574/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:48.533625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0785-7a7b-4b2a-b218-4a0a2f351e10 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:48.534020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0785-7a7b-4b2a-b218-4a0a2f351e10 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:48.534172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0785-7a7b-4b2a-b218-4a0a2f351e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:48.576922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:48.603734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a5a0785-7a7b-4b2a-b218-4a0a2f351e10 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:48.604956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a5a0785-7a7b-4b2a-b218-4a0a2f351e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:48.700984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 545/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:48.987892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:48.989456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:49.089342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b57b4-32c0-4bbd-82af-41e206b5e09b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:49.120993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:49.161507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:49.162100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:49.162376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:49.162664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:49.165009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:49.271888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:49.273889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429dbba-3688-4824-b5bd-b21224dcdb5b service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:49.291493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 575/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:51.608242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:51.608853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:51.608853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:51.610150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 546/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:51.615500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec73-498e-4e59-8c68-084b7ee11d20 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:51.616525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec73-498e-4e59-8c68-084b7ee11d20 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:51.616709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec73-498e-4e59-8c68-084b7ee11d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:51.683132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2dd2ec73-498e-4e59-8c68-084b7ee11d20 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:51.684319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2dd2ec73-498e-4e59-8c68-084b7ee11d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:51.696670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:51.779515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 576/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:52.063273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:52.064851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:52.169535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f060f55-0e4b-491f-9fb1-58c0feb5e924 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:52.182919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:52.244969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:52.245571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:52.245855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:52.246131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:52.247740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:52.356410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:52.357812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a2131-3eca-49dd-b395-585a89337460 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:52.376303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 547/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:54.898534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:54.899098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:54.899098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:54.900403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 577/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:54.905607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcbd99-a10e-4fe6-bec1-7c695626663e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:54.906043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcbd99-a10e-4fe6-bec1-7c695626663e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:54.906157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcbd99-a10e-4fe6-bec1-7c695626663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:54.955259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:54.973949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9bfcbd99-a10e-4fe6-bec1-7c695626663e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:54.975872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9bfcbd99-a10e-4fe6-bec1-7c695626663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:55.070914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 548/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:55.354119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:55.355643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:55.460723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4827-770a-4ef8-93d6-4be6d851ccab None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:55.500952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:55.534672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:55.535267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:55.535542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:55.535805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:55.537956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:55.644431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:55.645817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068002a-d62f-4761-8cad-35c20b6abfd8 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:55.664485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 578/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:57.924950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:57.925505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:57.925505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:57.926820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 549/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:14:57.932070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f06f-b055-4928-89cd-16d73a4325cc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:57.932535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f06f-b055-4928-89cd-16d73a4325cc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:57.932649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f06f-b055-4928-89cd-16d73a4325cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:57.997209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cbe7f06f-b055-4928-89cd-16d73a4325cc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:14:57.998396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cbe7f06f-b055-4928-89cd-16d73a4325cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:58.018097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:58.094296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 579/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:14:58.378037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:14:58.379553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:58.487067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b7f72-984e-4262-a6bf-b1a547d36448 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:14:58.508191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:58.561738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:14:58.562336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:14:58.562614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:14:58.562884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:14:58.564448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:14:58.673053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:14:58.674430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565622fc-d6d1-4284-bfc4-f662f3362b9a service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:14:58.692622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 550/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:00.952147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:00.952778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:00.952778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:00.954071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 580/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:00.960069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ccfe-d9ed-4a06-91c1-a989c37b7145 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:00.960531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ccfe-d9ed-4a06-91c1-a989c37b7145 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:00.960636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742ccfe-d9ed-4a06-91c1-a989c37b7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:01.023699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:01.026636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4742ccfe-d9ed-4a06-91c1-a989c37b7145 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:01.028425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4742ccfe-d9ed-4a06-91c1-a989c37b7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:01.124786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 551/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:01.407821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:01.409466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:01.512870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d7f02-dfa6-4fbc-aa92-8459706df2c4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:01.561819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:01.586970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:01.587560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:01.587833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:01.588099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:01.589699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:01.698045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:01.699430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144e8fc-f38d-4fcd-9470-afb8d49ca5f4 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:01.717307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 581/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:03.951150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:03.951701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:03.951701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:03.953064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 552/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:03.958429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390531-d83c-4ec0-8c1b-d98e5f156846 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:03.958864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390531-d83c-4ec0-8c1b-d98e5f156846 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:03.959220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390531-d83c-4ec0-8c1b-d98e5f156846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:04.024127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fa390531-d83c-4ec0-8c1b-d98e5f156846 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:04.025340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fa390531-d83c-4ec0-8c1b-d98e5f156846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:04.054583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:04.122304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 582/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:04.410203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:04.411736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:04.515790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90b80b-c964-4239-af4a-a90e64db058e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:04.544653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:04.590633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:04.591236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:04.591514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:04.591786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:04.593406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:04.701814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:04.703158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28552a76-4a80-44f0-8969-3287bc1aea42 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:04.721149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 553/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:06.900904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:06.901464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:06.901464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:06.902825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 583/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:06.907980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d165f2e-de19-4a51-9d77-57a17dfda5ee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:06.908413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d165f2e-de19-4a51-9d77-57a17dfda5ee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:06.908633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d165f2e-de19-4a51-9d77-57a17dfda5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:06.974848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9d165f2e-de19-4a51-9d77-57a17dfda5ee None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:06.976045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d165f2e-de19-4a51-9d77-57a17dfda5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:06.984316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:07.074383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 554/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:07.353890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:07.355393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:07.462196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb42cb5-e594-41d5-ba55-6079affbe0de None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:07.519906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:07.540488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:07.541092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:07.541379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:07.541652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:07.543557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:07.654262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:07.655597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c99b1-e4e0-4483-9eb0-ebe9c2e14e84 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:07.674352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 584/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:09.883075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:09.883619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:09.883619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:09.885002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 555/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:09.890269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b5a2-b6f4-4426-a5b9-e5ca1b7bb80c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:09.890709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b5a2-b6f4-4426-a5b9-e5ca1b7bb80c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:09.890815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2b5a2-b6f4-4426-a5b9-e5ca1b7bb80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:09.956130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9de2b5a2-b6f4-4426-a5b9-e5ca1b7bb80c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:09.957358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9de2b5a2-b6f4-4426-a5b9-e5ca1b7bb80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:09.996008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:10.053664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 585/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:10.337337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:10.338878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:10.442055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be3a8-5a74-49e4-9a40-3ce9eb667d5c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:10.480465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:10.515519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:10.516143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:10.516418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:10.516715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:10.518289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:10.630942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:10.632404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbbade-2fb8-4d94-a0a3-b4292713e82f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:10.650670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 556/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:12.822340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:12.822876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:12.822876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:12.824214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 586/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:12.829731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8998-d15f-42ad-95a4-b779b9b15091 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:12.830176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8998-d15f-42ad-95a4-b779b9b15091 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:12.830288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8998-d15f-42ad-95a4-b779b9b15091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:12.897374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1f5c8998-d15f-42ad-95a4-b779b9b15091 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:12.898529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f5c8998-d15f-42ad-95a4-b779b9b15091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:12.917008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:12.995727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 557/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:13.286622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:13.288351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:13.390245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b897180-c1c7-4638-9cae-542d3aec2baf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:13.459798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:13.466834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:13.467429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:13.467708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:13.467974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:13.469584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:13.575715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:13.577136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774bddc-ccec-480f-b3d9-cfe3560fb3e3 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:13.595753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 587/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:15.749335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:15.749936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:15.749936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:15.751195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 558/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:15.756926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015a86-5383-4e10-90b1-bd73dba564b1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:15.757362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015a86-5383-4e10-90b1-bd73dba564b1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:15.757471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015a86-5383-4e10-90b1-bd73dba564b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:15.823901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c7015a86-5383-4e10-90b1-bd73dba564b1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:15.825133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c7015a86-5383-4e10-90b1-bd73dba564b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:15.872706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:15.920607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 588/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:16.203193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:16.204815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:16.308957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaf107-ad3d-4445-8d09-f5b48696a7bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:16.357682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:16.383839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:16.384431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:16.384744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:16.385015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:16.386601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:16.495008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:16.496439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7dda2-b695-4c41-a0bc-ec97c7d46cbb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:16.514988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 559/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:25.919096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=22 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:26.512581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=66 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:36.382795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67b4a-e480-41d2-b88a-be8a0ebd7345 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:36.383362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67b4a-e480-41d2-b88a-be8a0ebd7345 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:36.383362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67b4a-e480-41d2-b88a-be8a0ebd7345 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:36.384709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 589/1148] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:36.389961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8963f-0837-47e2-b39a-fd6e881083d6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:36.390380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8963f-0837-47e2-b39a-fd6e881083d6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:36.390491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8963f-0837-47e2-b39a-fd6e881083d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:36.458624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-85f8963f-0837-47e2-b39a-fd6e881083d6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:36.459812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-85f8963f-0837-47e2-b39a-fd6e881083d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:36.555671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 560/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:36.853312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:36.853619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:36.853889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:36.855199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 590/1150] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 31 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:36.860410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449678-a898-4581-8e14-02f73daa46fb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:36.860749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449678-a898-4581-8e14-02f73daa46fb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:36.861020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a449678-a898-4581-8e14-02f73daa46fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:36.937809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5a449678-a898-4581-8e14-02f73daa46fb None None] MFA Rules not processed for user `03e8c5ebd3eb4d1cab97c3d1eaff3f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:36.939001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a449678-a898-4581-8e14-02f73daa46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:36.960882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:37.021574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 561/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 31 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:37.029597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:37.031031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:37.132618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddeec4a-3332-4988-b0c9-54551a64adc9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:37.206091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:37.206690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:37.206965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:37.207235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:37.209464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:37.262522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:37.321817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:37.323163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99b609-8747-44ea-82fb-26dffff2fbef service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:37.341031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 591/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:39.609569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:39.610141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:39.610141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:39.611479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 562/1153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:39.617334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf02d1-5c22-442e-8400-583ca72a71f3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:39.617746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf02d1-5c22-442e-8400-583ca72a71f3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:39.617889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf02d1-5c22-442e-8400-583ca72a71f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:39.683118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c2cf02d1-5c22-442e-8400-583ca72a71f3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:39.684215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c2cf02d1-5c22-442e-8400-583ca72a71f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:39.779341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 592/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:40.050241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:40.051846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:40.176563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7cdb-d7e5-403c-8aee-8c76598713cd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:40.225340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:40.269649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:40.270880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:40.271158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:40.271432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:40.272069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:40.273125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:15:40.273125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:15:40.273125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:15:40.274263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c140-d857-4c38-9307-40ee0948958e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:40.294392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 563/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 31 19:15:40 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:15:42.546953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:42.547398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:42.547500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:42.548886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 593/1156] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:42.554867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eec4-46ab-470f-9e55-57cb573f57bc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:42.555324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eec4-46ab-470f-9e55-57cb573f57bc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:42.555545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939eec4-46ab-470f-9e55-57cb573f57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:42.622075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3939eec4-46ab-470f-9e55-57cb573f57bc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:42.623265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3939eec4-46ab-470f-9e55-57cb573f57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:42.718324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 564/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:43.007544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:43.009130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:43.019391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:43.153342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defd02-19fb-4f37-88d9-b234f2cf016b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:43.232280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:43.264701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:43.265225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:43.265502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:43.265771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:43.267342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:43.355966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:43.357979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e766f0-a685-4682-a137-56640f8ed656 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:43.376272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 594/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:45.708837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:45.709388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:45.709480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:45.710759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 565/1159] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:45.716119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b106a-9bf1-4f50-83fd-4b5e517fb5de None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:45.716570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b106a-9bf1-4f50-83fd-4b5e517fb5de None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:45.716703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b106a-9bf1-4f50-83fd-4b5e517fb5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:45.782326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3b1b106a-9bf1-4f50-83fd-4b5e517fb5de None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:45.783507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3b1b106a-9bf1-4f50-83fd-4b5e517fb5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:45.830051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:45.879824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 595/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:46.163763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:46.165494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:46.191203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:46.271658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc0cc-b285-4606-9352-fa6a322d09e0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:46.344894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:46.345495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:46.345796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:46.346069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:46.347669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:46.421868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:46.456879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:46.458911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd942-5abf-475e-8a5a-64361e50b54c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:46.477457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 566/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:48.665457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:48.665993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:48.665993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:48.667576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 596/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:48.673086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc33e4-6c4c-4334-9f42-785e61595026 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:48.673496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc33e4-6c4c-4334-9f42-785e61595026 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:48.673631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc33e4-6c4c-4334-9f42-785e61595026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:48.739558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-10bc33e4-6c4c-4334-9f42-785e61595026 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:48.740780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10bc33e4-6c4c-4334-9f42-785e61595026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:48.837552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 567/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:49.129766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:49.131350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:49.232959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0811cbc-2d0c-464c-95ae-650e0c64b662 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:49.305301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:49.306795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:49.307445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:49.307941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:49.308264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:49.310237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:49.417210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:49.418606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b697aa9-1b54-45cb-b85f-db9e7e19b055 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:49.437423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 597/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:51.746231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:51.746839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:51.746839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:51.748118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 568/1165] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:15:51.753355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064fb8-af74-4fe7-95d2-13ca1b99a901 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:51.753789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064fb8-af74-4fe7-95d2-13ca1b99a901 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:51.753899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064fb8-af74-4fe7-95d2-13ca1b99a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:51.821151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3f064fb8-af74-4fe7-95d2-13ca1b99a901 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:51.822337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3f064fb8-af74-4fe7-95d2-13ca1b99a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:51.874427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:51.918765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 598/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:15:52.219274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:52.220858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:52.258026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:52.327296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaada6a-6c93-428a-a3f1-e42bc7e4f51c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:52.400583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:52.401183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:52.401463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:52.401735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:52.403324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:52.483928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:52.512797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:52.514234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86ac3-a0dd-46c4-bebb-b71695160e91 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:52.532257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 569/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:15:54.888778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:54.889304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:54.889304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:54.890585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 599/1168] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 31 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:15:54.896328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810f2c-823f-4d2e-9132-e4fe3fe82579 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:54.896753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810f2c-823f-4d2e-9132-e4fe3fe82579 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:54.896900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810f2c-823f-4d2e-9132-e4fe3fe82579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:54.962664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3d810f2c-823f-4d2e-9132-e4fe3fe82579 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:15:54.963857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3d810f2c-823f-4d2e-9132-e4fe3fe82579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:55.060093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 570/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 31 19:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:15:55.348990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:15:55.350542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:55.454969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86db1-2252-425a-ab33-d1a7f79236a3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:15:55.529986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:15:55.530586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:15:55.530864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:15:55.531138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:15:55.532761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:15:55.541293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:55.640918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:15:55.642258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec357ba-ca29-4895-9fe9-9ad9344c2fbc service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:15:55.660056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 600/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:16:05.058580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=82 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:16:05.657931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=50 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:09.949248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:09.949823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:09.949823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.026291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:17:10.027518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.122855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 571/1171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:17:10.130615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:10.131123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:10.131236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.204266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:17:10.205604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.299117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 601/1172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:17:10.303703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:10.304932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.316275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ae610-8e44-412f-990c-c9ac9f34610a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:10.379977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:10.413809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:10.414410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:10.414685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:10.414950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.415585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:17:10.415873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:10.417208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:17:10.417208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:17:10.417208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:17:10.418164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:10.429613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 572/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:17:10.439026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:10.447999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335d371-0ee8-46f1-87f9-2b57712f930d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:10.509892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:10.544012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:10.544648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:10.544927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:10.545197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.545835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:10.546990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:17:10.546990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:17:10.546990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:17:10.548273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:10.604250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 602/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:17:10 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:17:10.608406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:10.609934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.644073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201d032-a7bd-488f-8333-577b6381ab56 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:10.736085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:10.736737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:10.737012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:10.737279 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.737907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:10.738910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:17:10.738910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:17:10.738910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:17:10.740101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:10.784048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 573/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:17:10 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:17:10.788165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:10.789783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.852215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4643060-043f-4378-9b07-e9b019295706 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:10.934261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:10.945785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:10.946380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:10.946657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:10.946932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:10.947568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:10.949174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:10.961813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 603/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:17:10.965931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:10.967488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:10.979516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bb008-0046-41f2-bc21-449cd399eb95 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:11.006148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:11.076536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:11.077140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.077414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.077684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.078313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:11.079950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec393142-d54e-47cb-a873-7cd296256c24 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:11.091928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 574/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:17:11.096211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:11.097756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:11.130950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c195-f56f-4e61-a378-00f6a2e4ccfc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:11.221467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:11.222105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.222383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.222654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] PATH_INFO: `/v3/projects/da969ce68cab411b85dd8a0f749b531c/users/bddcabec44dd4816a83f911ba6533969/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.244816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da969ce68cab411b85dd8a0f749b531c, user_id=bddcabec44dd4816a83f911ba6533969, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:11.247450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f39271-dec4-4080-952d-4d5bde8c8475 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:11.272680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 604/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:17:11 2022] PUT /identity/v3/projects/da969ce68cab411b85dd8a0f749b531c/users/bddcabec44dd4816a83f911ba6533969/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:17:11.283764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b215-0399-459a-b1dc-31b10968f4fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.284052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b215-0399-459a-b1dc-31b10968f4fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.284330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b215-0399-459a-b1dc-31b10968f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.342942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4a10b215-0399-459a-b1dc-31b10968f4fd None None] MFA Rules not processed for user `bddcabec44dd4816a83f911ba6533969`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:17:11.344133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a10b215-0399-459a-b1dc-31b10968f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:11.423944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 575/1179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:17:11.436958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.437248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.437523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.438964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 605/1180] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 31 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:17:11.443774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e530-0b6a-499f-bbdc-b9d13a6070a8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.444058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e530-0b6a-499f-bbdc-b9d13a6070a8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.444330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e530-0b6a-499f-bbdc-b9d13a6070a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.482284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:11.527742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c847e530-0b6a-499f-bbdc-b9d13a6070a8 None None] MFA Rules not processed for user `1b15ab0375434a93834a3591da357114`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:17:11.528967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c847e530-0b6a-499f-bbdc-b9d13a6070a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:11.604104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 576/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 31 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:17:11.612554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:11.614072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:11.662964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:11.716178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079f4f-15f4-4ca6-b29e-8cd5e5017b21 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:11.790800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:11.791644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.791930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.792199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.793799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:11.889122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:11.890539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:11.894444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:11.909328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 606/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:17:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:17:11.953595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad67c0-3e5d-4e08-8871-18d54cb5cdff None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:11.953885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad67c0-3e5d-4e08-8871-18d54cb5cdff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:11.954703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad67c0-3e5d-4e08-8871-18d54cb5cdff None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:11.955937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 577/1183] 10.222.0.23 () {52 vars in 830 bytes} [Mon Oct 31 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:17:11.959603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:11.960953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:12.057694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7a27-0aee-416d-9861-52b739cc1396 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:12.149441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:12.150074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:12.150322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:12.150589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] PATH_INFO: `/v3/users/bddcabec44dd4816a83f911ba6533969` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:12.163001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bddcabec44dd4816a83f911ba6533969)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:12.164005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:17:12.164005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:17:12.164005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:17:12.165245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:12.174889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:12.230927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bddcabec44dd4816a83f911ba6533969'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:12.254393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bddcabec44dd4816a83f911ba6533969'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:12.268957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bddcabec44dd4816a83f911ba6533969'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:12.277627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bddcabec44dd4816a83f911ba6533969'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:12.278171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bddcabec44dd4816a83f911ba6533969'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:12.284286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 607/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:17:11 2022] DELETE /identity/v3/users/bddcabec44dd4816a83f911ba6533969 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:17:12.288867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:12.289365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:12.289471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:12.347410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:17:12.348573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:12.426153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:12.439292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 578/1185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:17:12.449023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:12.450234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:12.550387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0313-cf96-47f8-9681-98b0c01863a7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:12.602863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:12.624005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:12.624654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:12.624940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:12.625211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:12.627523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:12.735010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:12.737031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e490-825c-4296-b5be-1d1388e779b3 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:12.755287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 608/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:17:13.108247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:17:13.109505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:17:13.121588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411074df-5262-46bd-b31b-9f990de2ba83 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:17:13.220366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:17:13.221035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:17:13.221314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:17:13.221586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] PATH_INFO: `/v3/projects/da969ce68cab411b85dd8a0f749b531c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:17:13.231380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da969ce68cab411b85dd8a0f749b531c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:17:13.232401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:17:13.232401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:17:13.232401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:17:13.233625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:17:13.293090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da969ce68cab411b85dd8a0f749b531c', 'request_id': 'req-6a601b41-7772-4d49-9ed1-644e69c4a5b9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:13.303374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da969ce68cab411b85dd8a0f749b531c', 'request_id': 'req-6a601b41-7772-4d49-9ed1-644e69c4a5b9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:13.309939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da969ce68cab411b85dd8a0f749b531c', 'request_id': 'req-6a601b41-7772-4d49-9ed1-644e69c4a5b9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:13.340111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] The token cache is being invalidate because project da969ce68cab411b85dd8a0f749b531c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:17:13.340397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:13.340877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a601b41-7772-4d49-9ed1-644e69c4a5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:17:13.342258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 579/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:17:13 2022] DELETE /identity/v3/projects/da969ce68cab411b85dd8a0f749b531c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:17:22.753001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=62 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:17:23.338076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:43.149058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:43.149662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:43.149662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:43.151020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 609/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:18:43.155886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceade64-fb98-4ec9-a90b-68ab881a2662 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:43.156302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceade64-fb98-4ec9-a90b-68ab881a2662 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:43.156437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceade64-fb98-4ec9-a90b-68ab881a2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:43.237726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aceade64-fb98-4ec9-a90b-68ab881a2662 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:43.238929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aceade64-fb98-4ec9-a90b-68ab881a2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:43.342453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 580/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:43.502501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:18:43.504677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:43.623385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486598-30a5-43b8-a372-5419a9f4bf9c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:18:43.632653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:18:43.633676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:43.634605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:43.634885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:43.646384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:18:43.647979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b128f-038f-4ac7-a698-1af504a2e671 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:18:43.658065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 610/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:18:44.730877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826af5b-b0c8-4aa0-b4d1-553b82660aa0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:44.731443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826af5b-b0c8-4aa0-b4d1-553b82660aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:44.731443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826af5b-b0c8-4aa0-b4d1-553b82660aa0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:44.732802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 581/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:18:44.738405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e93bc-dfcc-4247-bfed-f0e3632d48be None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:44.738874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e93bc-dfcc-4247-bfed-f0e3632d48be None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:44.739130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e93bc-dfcc-4247-bfed-f0e3632d48be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:44.759544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-286e93bc-dfcc-4247-bfed-f0e3632d48be None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:44.760818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-286e93bc-dfcc-4247-bfed-f0e3632d48be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:44.768817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 611/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:44.925999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826af5b-b0c8-4aa0-b4d1-553b82660aa0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:18:44.940331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826af5b-b0c8-4aa0-b4d1-553b82660aa0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:18:44.945775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:18:44.946359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:44.946640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:44.946914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:44.955085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:18:44.956702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b016-620a-4345-9f65-1238fd364126 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:18:44.966021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 582/1193] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:18:45.108788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152b3a-b6b3-4ea6-8d69-7e28757f1b43 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:45.109074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152b3a-b6b3-4ea6-8d69-7e28757f1b43 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:45.109350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f152b3a-b6b3-4ea6-8d69-7e28757f1b43 None None] PATH_INFO: `/v3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:45.110672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 612/1194] 10.222.0.17 () {54 vars in 925 bytes} [Mon Oct 31 19:18:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:18:45.116794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bc5-00dd-4e5c-878a-fc81fec1cad7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:45.117083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bc5-00dd-4e5c-878a-fc81fec1cad7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:45.117363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bc5-00dd-4e5c-878a-fc81fec1cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:45.176989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-edfd8bc5-00dd-4e5c-878a-fc81fec1cad7 None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:45.178115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-edfd8bc5-00dd-4e5c-878a-fc81fec1cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:45.194650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:45.250845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 583/1195] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Oct 31 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:48.861821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887032-a710-4524-ab9f-a1d0561b229c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:48.862287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887032-a710-4524-ab9f-a1d0561b229c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:48.862384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb887032-a710-4524-ab9f-a1d0561b229c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:48.863741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 613/1196] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:18:48.868827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6764f7-bade-4684-b19c-6eb6acaf0794 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:48.869272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6764f7-bade-4684-b19c-6eb6acaf0794 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:48.869596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6764f7-bade-4684-b19c-6eb6acaf0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:48.889620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9b6764f7-bade-4684-b19c-6eb6acaf0794 None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:48.890734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b6764f7-bade-4684-b19c-6eb6acaf0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:48.900023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 584/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:48.907866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb887032-a710-4524-ab9f-a1d0561b229c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:18:48.922034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb887032-a710-4524-ab9f-a1d0561b229c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:18:48.928657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:18:48.929266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:48.929571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:48.929850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:48.938198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:18:48.939755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3c5e-99fb-4f4c-8401-43e032aec80a service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:18:48.949099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 614/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:18:56.457752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070208c6-0ef0-45a2-9325-20e00d48d756 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:56.458374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070208c6-0ef0-45a2-9325-20e00d48d756 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:56.458374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070208c6-0ef0-45a2-9325-20e00d48d756 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:56.459631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 585/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:18:56.464563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1957-dadc-4c3e-85a3-af2133e0c51f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:56.465010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1957-dadc-4c3e-85a3-af2133e0c51f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:56.465128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1957-dadc-4c3e-85a3-af2133e0c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:56.484745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6afe1957-dadc-4c3e-85a3-af2133e0c51f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:56.485915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6afe1957-dadc-4c3e-85a3-af2133e0c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:56.493765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 615/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:56.646712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070208c6-0ef0-45a2-9325-20e00d48d756 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:18:56.661536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070208c6-0ef0-45a2-9325-20e00d48d756 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:18:56.667080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:18:56.667672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:56.667948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:56.668216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:56.676689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:18:56.678251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa4a65-c0b9-490e-a2f0-e1953c1e9c94 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:18:56.687426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 586/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:18:57.754934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e263-e154-450a-ae66-a5b0fe627cdf None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:57.755508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e263-e154-450a-ae66-a5b0fe627cdf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:57.755508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e263-e154-450a-ae66-a5b0fe627cdf None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:57.756876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 616/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 19:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:18:57.761609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959975-a1e1-4c98-9c56-9e48d9ecad4b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:57.762032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959975-a1e1-4c98-9c56-9e48d9ecad4b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:57.762169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959975-a1e1-4c98-9c56-9e48d9ecad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:57.783087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c959975-a1e1-4c98-9c56-9e48d9ecad4b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:18:57.785572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c959975-a1e1-4c98-9c56-9e48d9ecad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:18:57.793971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 587/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:18:57.945784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7e263-e154-450a-ae66-a5b0fe627cdf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:18:57.960860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7e263-e154-450a-ae66-a5b0fe627cdf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:18:57.967178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:18:57.967790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:18:57.968072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:18:57.968348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:18:57.977542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:18:57.979119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ddd73-d311-43d4-8506-537056fce940 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:18:57.988518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 617/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:19:02.129896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49353-173d-4686-a227-3b12d822b31e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:02.130436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49353-173d-4686-a227-3b12d822b31e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:02.130436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49353-173d-4686-a227-3b12d822b31e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:02.131684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 588/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:19:02.136886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96892-0259-4a2e-bbdd-e98aae6d99fc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:02.137298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96892-0259-4a2e-bbdd-e98aae6d99fc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:02.137446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96892-0259-4a2e-bbdd-e98aae6d99fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:02.157929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-04b96892-0259-4a2e-bbdd-e98aae6d99fc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:19:02.159672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-04b96892-0259-4a2e-bbdd-e98aae6d99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:02.167745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 618/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:19:02.457424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49353-173d-4686-a227-3b12d822b31e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:19:02.459123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-82e49353-173d-4686-a227-3b12d822b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:02.536556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49353-173d-4686-a227-3b12d822b31e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:19:02.540177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:19:02.541067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:02.541359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:02.541634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:02.550605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:19:02.552067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e552e6-b7b2-4f0f-bbef-46b45f1595ba service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:19:02.561982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 589/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:19:04.709577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:04.710094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:04.710094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:04.711398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 619/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:19:04.716585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa99a-1956-4451-bf8f-3089985ba8f4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:04.717030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa99a-1956-4451-bf8f-3089985ba8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:04.717137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aa99a-1956-4451-bf8f-3089985ba8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:04.737202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-905aa99a-1956-4451-bf8f-3089985ba8f4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:19:04.738398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-905aa99a-1956-4451-bf8f-3089985ba8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:04.746127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 590/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:19:05.031113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:19:05.032805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:05.046413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684af57-506c-422a-be51-2b4bbffa3025 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:19:05.050560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:19:05.051159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:05.051415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:05.051683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:05.060874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:19:05.062297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaa303-e77f-495b-a0ce-6003e1e1ef9c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:19:05.071666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 620/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:19:08.710473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:08.711040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:08.711040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:08.712401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 591/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:19:08.717489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a801a0-c4d1-49de-a93d-3de1ed79a5a1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:08.717914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a801a0-c4d1-49de-a93d-3de1ed79a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:08.718046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a801a0-c4d1-49de-a93d-3de1ed79a5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:08.737466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-13a801a0-c4d1-49de-a93d-3de1ed79a5a1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:19:08.738656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-13a801a0-c4d1-49de-a93d-3de1ed79a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:08.746424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 621/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:19:09.048864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:19:09.050783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:09.115869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:19:09.129274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df2cc4-2570-47be-83f2-9953afe0785d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:19:09.132880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:19:09.133476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:09.133757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:09.134029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:09.142821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:19:09.144785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e62ac-234e-45fc-af5b-c9acbbdecdea service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:19:09.153937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 592/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:19:11.333560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:11.334124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:11.334124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:11.335527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 622/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 19:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:19:11.340952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311696-aa99-44de-8e2f-737a44f59925 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:11.341335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311696-aa99-44de-8e2f-737a44f59925 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:11.341513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311696-aa99-44de-8e2f-737a44f59925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:11.361791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-35311696-aa99-44de-8e2f-737a44f59925 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:19:11.363083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-35311696-aa99-44de-8e2f-737a44f59925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:11.370932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 593/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:19:11.671036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:19:11.672754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:19:11.685971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbe119-539f-413b-bd89-b8a5d43cbb98 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:19:11.689453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:19:11.690055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:19:11.690328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:19:11.690681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:19:11.699233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:19:11.700667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff2e12-605c-41d0-bf16-221fb079968b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:19:11.713502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 623/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:19:21.356916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=11 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:19:21.705839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:44.348533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.349195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.349195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.382391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:44.383620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:44.398083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 594/1217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:44.407609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.408214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.408214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.439590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:44.446582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:44.456375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 624/1218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:44.461267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.476132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81ccb-1991-4474-826b-8084b805efc4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.494172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.494813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.495186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.495478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.496189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:44.496634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:44.498447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:44.520142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 595/1219] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:44.528072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.546353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af31fa5-e0fc-4d90-95a3-b3cd10611b40 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.561898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.562560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.562947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.563400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.564493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:44.567781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:44.634489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 625/1220] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:44 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:44.638282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.656060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1960-1000-44ed-a8d9-7352cb3a7586 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.755561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.756222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.756526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.756805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.757844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:44.759866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:44.814278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 596/1221] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:44 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:44.822221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.845825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dedbd3-021a-43ed-b3e3-617bb070a4c2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.853678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.854581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.855075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.855544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.859931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:44.861986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:44.876096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 626/1222] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:44.880848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.901226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2d4e-0e3c-4cdc-84f7-eaf7622895e5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.915697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.916334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.916643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.916920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:44.917568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:44.919239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162e6cc-d00e-43de-aa78-ff8d80f7d811 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:44.942570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 597/1223] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:44.947741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:44.968093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52997b-14d4-4263-9192-16168d11e8b5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:44.981602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:44.982457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:44.982926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:44.983407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] PATH_INFO: `/v3/projects/7403453655654061994663e2390a3974/users/f6d1fa567a614b18a9b178a4c2ca6699/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.019244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7403453655654061994663e2390a3974, user_id=f6d1fa567a614b18a9b178a4c2ca6699, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.023890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d475d-95b5-4625-a38a-79f5c34f1eb4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.056630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 627/1224] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:44 2022] PUT /identity/v3/projects/7403453655654061994663e2390a3974/users/f6d1fa567a614b18a9b178a4c2ca6699/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:45.067133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015f70-06d0-4e0b-b9fb-992ed5e75bc1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.067493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015f70-06d0-4e0b-b9fb-992ed5e75bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.067722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015f70-06d0-4e0b-b9fb-992ed5e75bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.069091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e1e9-f7dc-4f65-8fca-91ade23b19dc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.069445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e1e9-f7dc-4f65-8fca-91ade23b19dc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.069744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e1e9-f7dc-4f65-8fca-91ade23b19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.113260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-41015f70-06d0-4e0b-b9fb-992ed5e75bc1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.115597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-41015f70-06d0-4e0b-b9fb-992ed5e75bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.129304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1945e1e9-f7dc-4f65-8fca-91ade23b19dc None None] MFA Rules not processed for user `f6d1fa567a614b18a9b178a4c2ca6699`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.130595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1945e1e9-f7dc-4f65-8fca-91ade23b19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.225796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 598/1225] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.230392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378bc1-7610-4d96-b068-c7c3a68a0f21 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.230392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378bc1-7610-4d96-b068-c7c3a68a0f21 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.230392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378bc1-7610-4d96-b068-c7c3a68a0f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.263029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fa378bc1-7610-4d96-b068-c7c3a68a0f21 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.264264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fa378bc1-7610-4d96-b068-c7c3a68a0f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.274324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 628/1226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:20:45.275576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d5-befc-473d-875c-8d16d1114edc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.275859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d5-befc-473d-875c-8d16d1114edc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.276132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d5-befc-473d-875c-8d16d1114edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.280533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 599/1227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.281814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760130-391e-410e-97de-052e77221bd0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.282096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760130-391e-410e-97de-052e77221bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.282364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760130-391e-410e-97de-052e77221bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.296775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-599443d5-befc-473d-875c-8d16d1114edc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.298210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-599443d5-befc-473d-875c-8d16d1114edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.303062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-90760130-391e-410e-97de-052e77221bd0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.304234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-90760130-391e-410e-97de-052e77221bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.306385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 629/1228] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.307624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f9a36-b409-4fc0-b246-b3c7c327accb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.308026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f9a36-b409-4fc0-b246-b3c7c327accb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.308309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f9a36-b409-4fc0-b246-b3c7c327accb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.312540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 600/1229] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.313551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b62d-e844-40c0-b9b3-544d215bf1a2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.313838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b62d-e844-40c0-b9b3-544d215bf1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.314112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b62d-e844-40c0-b9b3-544d215bf1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.334290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3a1f9a36-b409-4fc0-b246-b3c7c327accb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.335495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a1f9a36-b409-4fc0-b246-b3c7c327accb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.336248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a024b62d-e844-40c0-b9b3-544d215bf1a2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.337453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a024b62d-e844-40c0-b9b3-544d215bf1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.343678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 630/1230] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.345386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 601/1231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.346414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.346699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.346975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.349132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999402-d5a7-4349-ade1-b93f2f79db38 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.349652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999402-d5a7-4349-ade1-b93f2f79db38 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.350388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97999402-d5a7-4349-ade1-b93f2f79db38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.366553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.367755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.370893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-97999402-d5a7-4349-ade1-b93f2f79db38 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.372040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-97999402-d5a7-4349-ade1-b93f2f79db38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.375648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 602/1232] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.376388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.384506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 631/1233] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.384506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77735-63c9-4d46-8f88-f5bc723cbb28 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.384506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77735-63c9-4d46-8f88-f5bc723cbb28 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.384506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77735-63c9-4d46-8f88-f5bc723cbb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.389695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffe5a2-d89e-4015-b5c8-ca7f211b1930 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.394317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.395118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.395470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.395746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.396388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.397450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:20:45.397450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:20:45.397450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:20:45.398636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d79bbe-a5b9-4fc7-94db-06f0a27cf121 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.405741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d3e77735-63c9-4d46-8f88-f5bc723cbb28 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.406931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d3e77735-63c9-4d46-8f88-f5bc723cbb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.416275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 632/1234] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.417774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.418016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.418358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.428421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 603/1235] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.430265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2aaf7-ea04-4cf7-b9d8-40f95be1f825 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.430590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2aaf7-ea04-4cf7-b9d8-40f95be1f825 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.430867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2aaf7-ea04-4cf7-b9d8-40f95be1f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.439689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.440940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.450969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d2b2aaf7-ea04-4cf7-b9d8-40f95be1f825 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.452150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2b2aaf7-ea04-4cf7-b9d8-40f95be1f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.457572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:45.486567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:45.503319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 633/1236] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.504163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.513673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6524a-4543-41df-a04d-1feaddfa9ad4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.515183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 604/1237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.516872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dac70-e43e-43f4-9ea1-8da7a1ed0693 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.517168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dac70-e43e-43f4-9ea1-8da7a1ed0693 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.517443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dac70-e43e-43f4-9ea1-8da7a1ed0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.518953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.519592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.519905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.520178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.520870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.521174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.522201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:20:45.522201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:20:45.522201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:20:45.523080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4347b-5fee-4d5e-97e2-23dd3bcbaa5b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.542940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 634/1238] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.542940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.542940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.542940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.543361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8e5dac70-e43e-43f4-9ea1-8da7a1ed0693 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.543361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e5dac70-e43e-43f4-9ea1-8da7a1ed0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.548086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 605/1239] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.549392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756734-0517-479d-8b18-b01787a75472 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.549683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756734-0517-479d-8b18-b01787a75472 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.549966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756734-0517-479d-8b18-b01787a75472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.558286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.559494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.567820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 635/1240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.568687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.570650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dc756734-0517-479d-8b18-b01787a75472 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:45.571823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dc756734-0517-479d-8b18-b01787a75472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:45.578050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e303f-136d-4ea3-8009-52c82ef9acee None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.579772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 606/1241] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:45.579772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc756734-0517-479d-8b18-b01787a75472 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.585434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.586068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.586347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.586624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.587271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.587605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.589243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.590570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc756734-0517-479d-8b18-b01787a75472 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.595925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.596620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.596904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.597177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.597808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.600311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.602298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 636/1242] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.602890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.613330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c3d8a-480a-451e-b82d-9d132d63b53d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.618760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.620704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.620848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.621131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.622331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.622675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.624631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.635431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 607/1243] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.635431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.646858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 637/1244] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.646858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.647165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040722af-4684-4975-9934-418b7058cc93 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.651394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.651573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14381bc-0500-48da-b89b-adaa3b4e16a9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.652239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.652239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.652563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.653216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.653599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.655168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.656394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.657149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.657428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.657845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.658546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.661148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.669855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 608/1245] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.679002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.690326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df939f-a459-44ed-a8a6-0b44b27fe5c3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.690721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 638/1246] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.691669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.755749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.756257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.756571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.756850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.757098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308128-3ebb-4b07-98d4-014c6fdc917a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.757496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.757801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.759432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.761817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.762413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.762689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.762983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.763622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.763922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.765533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.772782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 609/1247] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.776747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.780856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 639/1248] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.782237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.784767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf58a4-fe59-4cc4-a48a-3a0f6c7abaf2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.793598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbae38-cdb6-433f-902a-6e42aa40779d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.794209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.794828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.795138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.795417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.796088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:45.796392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.798044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.798436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.799027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.799302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.799577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.800200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.803228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.811315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 610/1249] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:45.811942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.826216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8cff-d937-4ab3-8eb2-eb23b61c4f69 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.832076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.832831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.833113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.833386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.834026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.835641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.840415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 640/1250] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.840415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.849311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 611/1251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:45.850221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.860018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2db45-1b5e-4737-bbd2-323315bd589e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.894683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:45.895869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:45.901117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333d304-7410-4012-926b-a0e06e0a67cd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:45.906944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.907554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.907833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.908105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.908775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.910727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.919638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:45.920251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:45.920563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:45.920872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:45.921494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:45.923400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:45.940444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 641/1252] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.945985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:45.958257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 612/1253] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:45.959096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.021366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdbe6-25ba-49a3-97be-0470062ac03c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.027014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28311f-112f-4d84-b562-d9e44c93a2ea admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.027829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.028432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.028754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.029027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.029656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.030771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:20:46.030771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:20:46.030771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:20:46.032023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.032325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.033032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.033500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.033821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.034516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.036744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.057006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 642/1254] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.058078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.067871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb49e-a768-47ec-997c-98b3f5e57312 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.070353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 613/1255] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:45 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.071359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.125605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.126106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.126384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.126661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.127295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.129433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.138720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81563fd3-d82f-44f7-8e1c-bf9656c449d5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.143381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.143986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.144273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.144576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.145258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.147235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.164765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 643/1256] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.164765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.179681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 614/1257] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.180530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.215842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:46.220475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:46.226198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92efe-9155-4c3f-a596-b53210adabd9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.250582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa183b-7104-4ee5-9452-e600481b8ca2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.255267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.255925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.256201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.256495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] PATH_INFO: `/v3/projects/763733a0c802400dbcd8df66efce96ab/users/26d40ac1b1744cb3bbbb68cf1ca427a2/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.271280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763733a0c802400dbcd8df66efce96ab, user_id=26d40ac1b1744cb3bbbb68cf1ca427a2, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.274031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.286801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.287406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.287716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.288024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.288730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.289003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 615/1258] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/763733a0c802400dbcd8df66efce96ab/users/26d40ac1b1744cb3bbbb68cf1ca427a2/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:46.289907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.290895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.315821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 644/1259] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.315821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.324343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cc1-2974-424c-93fd-90394e62c654 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.355477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd03b-40e6-4c97-b2a6-558fd24eb1e1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.360062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.360688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.360971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.361248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.361876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.364024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.383091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.383701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.383981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.384252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.384918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.388976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 616/1260] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.388976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.389539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.396345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632629-ac40-49f7-8f25-428d00eaca9d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.402753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.403417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.403699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.403968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.404625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.406237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.408762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 645/1261] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.409629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.420424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 617/1262] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.420424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.420691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e40a34-055e-4944-a51b-557bc3e6a216 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.425342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.426046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.426819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.427091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.427790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.429727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.431112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af063-ec76-4430-8eb6-032783cc5a71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.436121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.436735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.437016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.437288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.437908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.439822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.452441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 646/1263] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.453188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.462768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 618/1264] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.463467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517027fa-f77b-4aab-9d08-d369d4cf07a9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.463645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.469817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.470404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.470683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.470959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.471576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.473442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42d9c5-8643-4e07-a591-27fda10d300c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.473899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.478297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.478914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.479188 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.479454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.480082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.481790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.493113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 619/1265] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.493959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.497086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 647/1266] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:46.497956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.504469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802a87e-af0f-432f-91cf-872d0056aaf4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.507623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a79f7-a533-475e-84d2-e148f95f8752 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.509025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.509610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.509916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.510184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.510807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.512267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.512396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.512888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.513170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.513448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.514079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.515669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.523112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 620/1267] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.523920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.529307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 648/1268] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.529307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.537104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56960-beb2-4bd1-abb4-de9e3cb4ee79 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.538868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbaf76-3990-453f-8cd6-bdc56bb64878 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.542438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.543082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.543364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.543590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.543700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.544181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.544284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.544483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.544767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.545396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.546031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.546959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.560738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 649/1269] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.560738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.561029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 621/1270] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.561029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.572664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41cf3a-8978-4fbe-9748-5d46967ead80 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.573918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31001e3-4180-4654-8818-88f1bd03c156 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.577783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.578383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.578519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.578665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.578939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.579090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.579390 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.579569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.579682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.580279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.581232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.581900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.592424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 622/1271] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.593261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.595483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 650/1272] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.596427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.605564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddab51b-640b-4499-bfd6-91ed3a62e193 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.606502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8485420-df2f-476e-96a3-4f02a472921a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.610114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.610758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.611034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.611158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.611340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] PATH_INFO: `/v3/projects/763733a0c802400dbcd8df66efce96ab/users/26d40ac1b1744cb3bbbb68cf1ca427a2/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.611626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.611905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.612179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.612838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.613229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=763733a0c802400dbcd8df66efce96ab, user_id=26d40ac1b1744cb3bbbb68cf1ca427a2, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.615043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.616544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.626034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 651/1273] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.626823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.629682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 623/1274] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/763733a0c802400dbcd8df66efce96ab/users/26d40ac1b1744cb3bbbb68cf1ca427a2/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:46.630598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.632020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:46.637417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34479c-1d9c-4d98-995a-cd79c8ad93d6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.659451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:46.699566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.700176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.700451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.700750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.701388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.702974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.705139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e331a-4408-484f-ba3a-4916598e2a5f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.710256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.710859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.711139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.711411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.712044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.712970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 652/1275] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.713590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.713708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.722675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc521-aef4-42d1-aaaa-e86db2b33249 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.728132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 624/1276] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.728132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.730965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.731610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.731893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.732208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] PATH_INFO: `/v3/projects/a185558eaa494884960bd5fb9102a736/users/7f29a88591064a67bdb7644471beeb24/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.737636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddda2ab-3348-48db-9c70-1bfcb5a3d519 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.742860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.743443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.743723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.743995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.744661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.746330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.748776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a185558eaa494884960bd5fb9102a736, user_id=7f29a88591064a67bdb7644471beeb24, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.751401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.756666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 625/1277] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.757926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.768113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27f84-898f-44f7-bdad-85855b600048 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.768326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 653/1278] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/a185558eaa494884960bd5fb9102a736/users/7f29a88591064a67bdb7644471beeb24/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:46.769207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.828599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.829134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.829421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.829696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.830341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.832012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.834137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ef407-9836-4379-bb72-d00969b81891 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.838647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.839242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.839522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.839797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.840431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.842060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b93d-bb52-479b-8f7f-ba0515715bfe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.842496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 626/1279] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.843306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.856336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 654/1280] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.856336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.856336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.856336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.859345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59971-f795-46d4-8116-2b759e1dff23 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.865586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.866190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.866492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.866772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.867408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.869047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.879664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 627/1281] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:46.881000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.886141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] MFA Rules not processed for user `26d40ac1b1744cb3bbbb68cf1ca427a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:46.887329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:46.890343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3c2ca-ad88-4b66-bc90-dbd8a35286eb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.896025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:46.896703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:46.896989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:46.897270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] PATH_INFO: `/v3/projects/35bad175808b44acb71a290ef40f5a41/users/78e787ce17fc46fc800b15c9b647220b/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:46.912139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bad175808b44acb71a290ef40f5a41, user_id=78e787ce17fc46fc800b15c9b647220b, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:46.915025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:46.928681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 628/1282] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/35bad175808b44acb71a290ef40f5a41/users/78e787ce17fc46fc800b15c9b647220b/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:46.929498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.953444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:46.968670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 655/1283] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:46.968670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:46.976096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e88f3-9c4d-4f02-a362-d5e9bc451d91 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:46.998297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ada1-b20a-4bef-be76-0ff466c10a15 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.003221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.003883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.004798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.005036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] PATH_INFO: `/v3/projects/a6ae957b746448a3b38f475d1fcbfab3/users/fd2e5a20bdeb4fe3abe152d2abbe9c2e/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.016966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:47.023252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ae957b746448a3b38f475d1fcbfab3, user_id=fd2e5a20bdeb4fe3abe152d2abbe9c2e, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.027109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dbf08-d96a-4332-b0bf-e2d831834438 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.033207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.033986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.034300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.034564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] PATH_INFO: `/v3/projects/9d912a1d90174a96b8551a65f23ec776/users/f3bb55041a374035ad251e7706a144c2/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.040779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 629/1284] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/a6ae957b746448a3b38f475d1fcbfab3/users/fd2e5a20bdeb4fe3abe152d2abbe9c2e/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:47.042204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.042504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.042776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.049819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d912a1d90174a96b8551a65f23ec776, user_id=f3bb55041a374035ad251e7706a144c2, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.052592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.061314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.062508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.067783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 656/1285] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:46 2022] PUT /identity/v3/projects/9d912a1d90174a96b8551a65f23ec776/users/f3bb55041a374035ad251e7706a144c2/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:47.068634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.127409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 630/1286] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.128157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.130460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761915d-4f5d-49ce-a147-3c5482cd6ccf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.135647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.136340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.136652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.136936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] PATH_INFO: `/v3/projects/e4a6e0fb608b425fb7754f2369cb39c1/users/4a2c5114e8b148c988598ddc2ce5a2b0/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.138164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fe61e-1334-4fb2-99c2-ce390c95f82e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.142821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.143475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.143757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.144031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] PATH_INFO: `/v3/projects/16971e18aa734019aaf880bbb8460e3c/users/6125c4934d214b399d0a29ac8fb220a7/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.152881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6e0fb608b425fb7754f2369cb39c1, user_id=4a2c5114e8b148c988598ddc2ce5a2b0, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.155543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.159659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16971e18aa734019aaf880bbb8460e3c, user_id=6125c4934d214b399d0a29ac8fb220a7, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.162530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a3d71-7895-4dd6-944d-8a6ad37e2598 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.169624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 657/1287] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:47 2022] PUT /identity/v3/projects/e4a6e0fb608b425fb7754f2369cb39c1/users/4a2c5114e8b148c988598ddc2ce5a2b0/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:47.170570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.176378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 631/1288] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:47 2022] PUT /identity/v3/projects/16971e18aa734019aaf880bbb8460e3c/users/6125c4934d214b399d0a29ac8fb220a7/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:47.177846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.178200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.178480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.198971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.200167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.235454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff13a35-6fa2-4a01-b978-1c8bd48d3ed1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.240971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:47.262975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 632/1289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.263973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.297928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.298625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.298907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.299184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] PATH_INFO: `/v3/projects/c3cfa27d581a422c9dc22f3be5139ad8/users/5f1b3a50127f4548a20907a9c42b889d/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.315141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cfa27d581a422c9dc22f3be5139ad8, user_id=5f1b3a50127f4548a20907a9c42b889d, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.318428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995b6c7-f7ab-4c81-b62e-e62fad0100db admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.320042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a441-4b8e-44d4-94ad-dc53f38b29ab None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.323773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.324416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.324683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.324982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.331297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 658/1290] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:47 2022] PUT /identity/v3/projects/c3cfa27d581a422c9dc22f3be5139ad8/users/5f1b3a50127f4548a20907a9c42b889d/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:47.335069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.335069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.335069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.348905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:47.353944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.355158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.393337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.395299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c46e-bf58-4670-bc4e-4481f9fc87ec service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.405226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 633/1291] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:47.406464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5c75-5f3c-4f3b-856b-e9f93cd22e1a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.406751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5c75-5f3c-4f3b-856b-e9f93cd22e1a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.407027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5c75-5f3c-4f3b-856b-e9f93cd22e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.418077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 659/1292] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.419057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.433148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1c4f5c75-5f3c-4f3b-856b-e9f93cd22e1a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.434844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1c4f5c75-5f3c-4f3b-856b-e9f93cd22e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.448898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 634/1293] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.448898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.448898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.448898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.485641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c349f-c1d9-40f1-b0a9-54602436fe70 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.489954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] MFA Rules not processed for user `4a2c5114e8b148c988598ddc2ce5a2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.490727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.491384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.491665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.491942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.492248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.501669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.503101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff993f-6e0d-4e31-b23d-926a3b2beb2c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.516616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 660/1294] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:47.516616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.516616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.516830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.554559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] MFA Rules not processed for user `6125c4934d214b399d0a29ac8fb220a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.555948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.607316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 635/1295] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.608632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:47.610481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.624755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf2595-326b-4421-bffa-8e030dd79313 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.632106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.632976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.633374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.633841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.645570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.647221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd8d90-6a3c-40d2-b89d-960791bb41d0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.662979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 636/1296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:47.674177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 661/1297] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.674177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.674960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.674960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.674960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.695010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038e66-6ecf-4ab6-9faa-f33b41e976ba None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.702228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:47.703522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:47.703669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.704343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.704918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.705255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.712888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 637/1298] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:47.713919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.720626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.722259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.731560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f80da-76bb-4d7e-9ac4-39e72027c3a4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.737591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 662/1299] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:47.738845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.741201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.741820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.742104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.742433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.752868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.755140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.756199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd0670-89db-45b3-8866-86ac0ad13b57 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.763814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:47.764498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:47.764804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:47.765066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:47.765754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:47.767382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 638/1300] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:47.768217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.782488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:47.871349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 663/1301] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:47 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:47.871349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:47.872289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a42f-e3b0-4ad1-9a8f-5bdd29c2dddb service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:47.927837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:48.004504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.006482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.007035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.007624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.014085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c9ca-bd2b-45cc-b8b1-76b6a39cf362 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.019293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.021548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.021905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.022253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.115646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.117425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.130467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 639/1302] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:48.145964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.164555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.166840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.181053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 664/1303] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:48.182512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.194187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ec98-94ce-4825-8fa7-197c4cf1f1e0 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.215815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.216846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.217607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.218771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] PATH_INFO: `/v3/users/f6d1fa567a614b18a9b178a4c2ca6699` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.221368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d1fa567a614b18a9b178a4c2ca6699)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.226652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.273112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387746e-2d15-41b7-998f-4c43cdbb19f9 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.279395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.280389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.280901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.281415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.282227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.286162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.336706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 640/1304] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:48.338275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:48.340518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.368193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d1fa567a614b18a9b178a4c2ca6699'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:48.368428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa339c2-e429-474b-ac42-07033c34002a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.391680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.392274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.392591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.392872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.393528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.400029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.411259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d1fa567a614b18a9b178a4c2ca6699'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:48.420195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d1fa567a614b18a9b178a4c2ca6699'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:48.430173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 641/1305] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:48.431867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d1fa567a614b18a9b178a4c2ca6699'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:48.433703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-157fca44-d9fe-4c67-935f-e428a8fc5e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d1fa567a614b18a9b178a4c2ca6699'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:48.434373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.439366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:48.443709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 665/1306] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:20:48 2022] DELETE /identity/v3/users/f6d1fa567a614b18a9b178a4c2ca6699 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:48.450313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.450606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.450889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.468905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268eeb44-5f01-4851-b58b-a728ce07b591 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.470309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:48.471524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:48.564358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 666/1307] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:48.578727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.580492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:48.607538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:48.628099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.628099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.628495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.628894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] PATH_INFO: `/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe/users/60e95abf0fce4c8781d21bba42bbd5db/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.655928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced98eb54b4e4f53948aa2a8198a77fe, user_id=60e95abf0fce4c8781d21bba42bbd5db, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.669908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.697015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 642/1308] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:48 2022] PUT /identity/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe/users/60e95abf0fce4c8781d21bba42bbd5db/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:48.702088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.711583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ee49d-6539-4d9b-bdcf-4a3527bf339f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.804207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0af01-4112-435f-bca5-4d1b12c1ad8a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.810740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.811788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.812151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.812429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.813376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.815675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.817596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.818792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.819314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.819821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.831947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 643/1309] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:48.833008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.833787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:48.835023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184e03-0271-418f-a8e0-139aaa35ae25 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.845253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb4ca-9859-44b2-b18d-8f19cab13ec3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:48.847436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 667/1310] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:48.855800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:48.857355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.857744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.858307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] PATH_INFO: `/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe/users/60e95abf0fce4c8781d21bba42bbd5db/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.862647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced98eb54b4e4f53948aa2a8198a77fe, user_id=60e95abf0fce4c8781d21bba42bbd5db, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:48.867078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:48.880889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 644/1311] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:48 2022] PUT /identity/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe/users/60e95abf0fce4c8781d21bba42bbd5db/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:48.891419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:48.891966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:48.892350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:48.918853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:48.934554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] MFA Rules not processed for user `60e95abf0fce4c8781d21bba42bbd5db`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:48.937794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:49.109301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 668/1312] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:49.117168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:49.120642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:49.205830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac590256-ab9b-4697-9c64-98fd275018bc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:49.210620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:49.211418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:49.211699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:49.211975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:49.225149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:49.227019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:49.240631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 645/1313] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:20:49.371764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:49.382550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c713f7-e915-4cf6-82d9-95922d83c378 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:49.387279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:49.388415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:49.388943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:49.389389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:49.392005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:49.474318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:49.475888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4374bf-3609-4841-b57b-48ef9f5087e6 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:49.497723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 669/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:49.813225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:49.814853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:49.978884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5c9d-636e-4eeb-bb47-1fd4d6da72ed service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:49.991452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:49.992258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:49.992435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:49.992804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] PATH_INFO: `/v3/projects/7403453655654061994663e2390a3974` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:49.994125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7403453655654061994663e2390a3974)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:49.996412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:50.015095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:50.037072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.037623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.037836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:50.100534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] MFA Rules not processed for user `78e787ce17fc46fc800b15c9b647220b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:50.102324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:50.125500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7403453655654061994663e2390a3974', 'request_id': 'req-da038586-c8b2-406d-99a1-7f87f1af3c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.141910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7403453655654061994663e2390a3974', 'request_id': 'req-da038586-c8b2-406d-99a1-7f87f1af3c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.157296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7403453655654061994663e2390a3974', 'request_id': 'req-da038586-c8b2-406d-99a1-7f87f1af3c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.178266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] The token cache is being invalidate because project 7403453655654061994663e2390a3974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:20:50.178568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.179402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.180975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 646/1315] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:20:49 2022] DELETE /identity/v3/projects/7403453655654061994663e2390a3974 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:50.185463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:50.187139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:50.289333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 670/1316] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:20:50.291966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:50.296593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:50.350788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038586-c8b2-406d-99a1-7f87f1af3c97 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:50.366406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:50.367762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.369370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.369758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] PATH_INFO: `/v3/users/26d40ac1b1744cb3bbbb68cf1ca427a2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:50.371410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d40ac1b1744cb3bbbb68cf1ca427a2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:50.374996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:20:50.374996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 19:20:50.374996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: Oct 31 19:20:50.379065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:50.389109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:50.484868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b31e-fbee-4285-b0fb-a3a7dc055527 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:50.500130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:50.501825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.502118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.502505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:50.505901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:50.512488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:50.545032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d40ac1b1744cb3bbbb68cf1ca427a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.571942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d40ac1b1744cb3bbbb68cf1ca427a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.595048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 671/1317] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:50 2022] POST /identity/v3/projects => generated 405 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:20:50.596155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:50.636063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d40ac1b1744cb3bbbb68cf1ca427a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.637472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d40ac1b1744cb3bbbb68cf1ca427a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.653550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d40ac1b1744cb3bbbb68cf1ca427a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:50.667333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 647/1318] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:20:50 2022] DELETE /identity/v3/users/26d40ac1b1744cb3bbbb68cf1ca427a2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:20:50.714788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970226f-eba1-4c7b-bce8-28e0829aa9d3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:50.792860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:50.793758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.794781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.794781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:50.795418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:50.799187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:50.846539 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 672/1319] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:50 2022] POST /identity/v3/users => generated 309 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:50.851940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:50.854201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:50.871801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41236-7429-47ef-9187-16a43cb24c41 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:50.891995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:50.893630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.895433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.896358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:50.897235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:50.901802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c28cc9-ac5d-44e1-961e-05264ada7eb0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:50.939494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 648/1320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:50.945461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:50.963843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91facba-b77a-423e-9a0d-f98af1e3993b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:50.991830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:50.995084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:50.995380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:50.996787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] PATH_INFO: `/v3/projects/591ab91eb27a4c679957fd8edf8a4de1/users/881050771e4f49d9bfc628b820153bf3/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.048024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591ab91eb27a4c679957fd8edf8a4de1, user_id=881050771e4f49d9bfc628b820153bf3, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:51.056737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:51.070672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128607b-2b99-4680-97cd-50982fdaad73 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.073102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128607b-2b99-4680-97cd-50982fdaad73 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.073882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128607b-2b99-4680-97cd-50982fdaad73 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.076914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 649/1321] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:20:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:20:51.102982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 673/1322] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:50 2022] PUT /identity/v3/projects/591ab91eb27a4c679957fd8edf8a4de1/users/881050771e4f49d9bfc628b820153bf3/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:51.108273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08ff1-7162-44dd-855b-d7ed429b79e6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.109012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08ff1-7162-44dd-855b-d7ed429b79e6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.110032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08ff1-7162-44dd-855b-d7ed429b79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.119061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:51.128440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:51.180024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:51.197154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ada08ff1-7162-44dd-855b-d7ed429b79e6 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:51.199007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ada08ff1-7162-44dd-855b-d7ed429b79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:51.244983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73235-363b-4ee3-b35a-7067940680d5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:51.257446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:51.258354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.258778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.259201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.260025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:51.262103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:51.289380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 674/1323] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:51.293152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:51.315664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06ef6e-27cb-4fa9-9f63-c569a3550a81 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:51.322970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:51.323893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.324381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.324905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] PATH_INFO: `/v3/projects/591ab91eb27a4c679957fd8edf8a4de1/users/881050771e4f49d9bfc628b820153bf3/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.327108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=591ab91eb27a4c679957fd8edf8a4de1, user_id=881050771e4f49d9bfc628b820153bf3, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:51.330405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8da5e-6046-44b5-9c89-2447d332ef6b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:51.344195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 675/1324] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:51 2022] PUT /identity/v3/projects/591ab91eb27a4c679957fd8edf8a4de1/users/881050771e4f49d9bfc628b820153bf3/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:51.344710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 650/1325] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:51.350201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.352724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.352724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.352724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 676/1326] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 19:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:20:51.361076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.361772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.362263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.390867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:51.393364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:51.500251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 651/1327] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:51.515204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:51.517646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:51.635618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b5cec-6747-44a1-8b32-ae529eec81a1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:51.646118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:51.646756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:51.647038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:51.647311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:51.669979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:51.677077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ec483-496a-4be3-9d84-e48030670bf3 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:51.714275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 677/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:52.132131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:52.133783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:52.291017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a345a7f-86c8-42a6-b27d-c9032fb9aee8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:52.304042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:52.307956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.308207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.308448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] PATH_INFO: `/v3/projects/763733a0c802400dbcd8df66efce96ab` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.310345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=763733a0c802400dbcd8df66efce96ab)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:52.318850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:52.362489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:52.416643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763733a0c802400dbcd8df66efce96ab', 'request_id': 'req-380cb859-6bbd-490b-ba5b-eb38de403d1d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:52.430651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763733a0c802400dbcd8df66efce96ab', 'request_id': 'req-380cb859-6bbd-490b-ba5b-eb38de403d1d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:52.439878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763733a0c802400dbcd8df66efce96ab', 'request_id': 'req-380cb859-6bbd-490b-ba5b-eb38de403d1d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:52.460196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] The token cache is being invalidate because project 763733a0c802400dbcd8df66efce96ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:20:52.461055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:52.462562 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-380cb859-6bbd-490b-ba5b-eb38de403d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:20:52.464947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 652/1329] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:20:52 2022] DELETE /identity/v3/projects/763733a0c802400dbcd8df66efce96ab => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:52.470337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.471457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.471987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.509482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:52.512219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:52.627635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 678/1330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:52.637101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.637391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.638202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.680730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:52.681989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:52.710253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:52.711091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 653/1331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:52.724887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca825-5cf1-4786-8224-f91469c817a8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:52.732778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:52.734249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.734876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.735333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.736184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:20:52.736622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:52.739361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:52.764812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:52.780547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 679/1332] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:20:52.781265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7e17-8611-4727-85ee-97876a637d37 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:52.786610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:52.787244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.787525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.788373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.789174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:52.791394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25de98c-a0a3-4720-b217-799955974263 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:52.834289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:52.841194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 654/1333] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:52 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:52.848489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7ac06-d022-42ea-99ec-ba2a36712888 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:52.922900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:52.995359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:52.995814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3f57-94a6-4624-9a95-31cb009e9c53 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.996021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:52.996141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3f57-94a6-4624-9a95-31cb009e9c53 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.996299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:52.996408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3f57-94a6-4624-9a95-31cb009e9c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.996616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:52.997221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:52.999150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:53.029537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 680/1334] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:52 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:53.033689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:53.047890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d1ba3f57-94a6-4624-9a95-31cb009e9c53 None None] MFA Rules not processed for user `881050771e4f49d9bfc628b820153bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:53.050782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1ba3f57-94a6-4624-9a95-31cb009e9c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:53.055595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518de6-d18b-4b49-af73-77cdbe3f90b8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:53.071865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:53.072738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.073222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.074612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.076669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:53.082208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:53.110353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 681/1335] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:20:53.116755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:53.133779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcb100-4334-45a0-b057-575d33d26492 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:53.152551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:53.153245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.153527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.153800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.155618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:53.158686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:53.177682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 682/1336] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:53.186805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:53.205198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5197af-2d75-41d6-8674-4e24d26479f3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:53.211698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:53.212267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.214563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.214708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] PATH_INFO: `/v3/projects/f1f9b7becc454dac95ff6bd7fcc40972/users/13dd7ff40d334863bc50affb7eb92c7f/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.237901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 655/1337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:20:53.249657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9b7becc454dac95ff6bd7fcc40972, user_id=13dd7ff40d334863bc50affb7eb92c7f, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:53.252992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:53.298718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.299964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.299964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.309760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 683/1338] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:53 2022] PUT /identity/v3/projects/f1f9b7becc454dac95ff6bd7fcc40972/users/13dd7ff40d334863bc50affb7eb92c7f/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:53.368672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] MFA Rules not processed for user `13dd7ff40d334863bc50affb7eb92c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:53.369823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:53.552795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:53.601798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:53.602811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 656/1339] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:53.748181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb5ff7-f58c-463c-8198-46a132e3a615 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:53.771739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:53.772619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.773162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.774294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.776230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:53.778992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:53.849173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 684/1340] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:20:53 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:53.850750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:53.870970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f637a7-bd10-4e07-838d-4f9afb27a811 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:53.982682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:53.982985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:53.983275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:53.983552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:53.984383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:53.986701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:54.033878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 657/1341] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:20:53 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:20:54.034398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.054810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c59c7-daa5-439f-89bd-df62a9bb53ea admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:54.062400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:54.064891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.065364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.066093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.067340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:54.069553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:54.089293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.095296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 685/1342] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:20:54.112435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abb73-a7c0-4b01-ba74-78eab046741c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:54.120929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:54.122128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.122610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.123110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] PATH_INFO: `/v3/projects/18fd4d5700474500bf3f83062c84c601/users/aa014db5dfd24bcc9c26153a20e52045/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.161986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fd4d5700474500bf3f83062c84c601, user_id=aa014db5dfd24bcc9c26153a20e52045, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:54.173324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10713a3-ae7d-4aa1-948c-db39b0c33888 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:54.231400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.232149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 658/1343] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:54 2022] PUT /identity/v3/projects/18fd4d5700474500bf3f83062c84c601/users/aa014db5dfd24bcc9c26153a20e52045/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:54.248155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae64c9-465b-43d5-9870-a5b0cc286fa8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:54.331000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414280e5-fe84-4a1f-9af9-609cbf2799bc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.331505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414280e5-fe84-4a1f-9af9-609cbf2799bc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.332659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414280e5-fe84-4a1f-9af9-609cbf2799bc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.336326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 659/1344] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:20:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:20:54.378007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117efe29-2941-450e-b01c-02598176ee4a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.378543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117efe29-2941-450e-b01c-02598176ee4a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.380042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117efe29-2941-450e-b01c-02598176ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.395513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:54.411536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:54.412176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.412620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.412970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.413754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:54.417063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:54.455551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 686/1345] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:20:54.456751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.473699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce20bf-3091-49e7-bca4-66aca9713da0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:54.479084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:54.479823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.480112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.480391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] PATH_INFO: `/v3/projects/18fd4d5700474500bf3f83062c84c601/users/aa014db5dfd24bcc9c26153a20e52045/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.482387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fd4d5700474500bf3f83062c84c601, user_id=aa014db5dfd24bcc9c26153a20e52045, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:54.485304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090a32e-88bb-4a0f-bfc5-c0af3d9e6e6d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:54.511651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 687/1346] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:20:54 2022] PUT /identity/v3/projects/18fd4d5700474500bf3f83062c84c601/users/aa014db5dfd24bcc9c26153a20e52045/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:20:54.514704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.514704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.515023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.517224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-117efe29-2941-450e-b01c-02598176ee4a None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:54.519707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-117efe29-2941-450e-b01c-02598176ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:54.578161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] MFA Rules not processed for user `aa014db5dfd24bcc9c26153a20e52045`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:54.583097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:54.666598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 660/1347] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:54.675386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e24-b836-4aad-8702-8ad6d9e0486f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.676046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e24-b836-4aad-8702-8ad6d9e0486f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.677019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e24-b836-4aad-8702-8ad6d9e0486f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.680942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 661/1348] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 19:20:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:20:54.685506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:54.685992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:54.686429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:54.779168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:54.783904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:54.821854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 662/1349] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:54.830504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 688/1350] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:54.836545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.838939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:54.845026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:54.850847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:54.953930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:54.991341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3828c8-d25a-4191-9fff-0589fdfe413e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:55.005039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:55.010147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:55.010709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:55.011313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:55.021258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44f66-1e45-4724-965c-8cb9b5b7f357 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:55.029002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:55.029649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:55.030952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:55.031237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:55.039916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:55.042044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:55.053739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:55.056549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d17af5-c0ca-458f-91f5-990b3c59b390 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:55.063735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 663/1351] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:55.076169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 689/1352] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:55.435730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:55.445742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959c2d-443c-4431-92b2-c22869fd1a22 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:55.464363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:55.465050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:55.465333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:55.465609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:55.635558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:55.637072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accff79d-02a2-46f3-a21d-aa99db0bbfb7 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:55.664330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 664/1353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:20:57.028344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:57.029064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:57.029535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:57.035651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 690/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:20:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:20:57.202330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:57.203777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:57.204962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:57.249623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:20:57.253056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:57.421155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 665/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:20:57.518518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:20:57.521475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:20:57.589585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adabc-834b-412f-ab95-f8a7951f72a0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:20:57.614088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:20:57.621227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:20:57.622245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:20:57.623001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:20:57.662766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:20:57.665139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c6d9c-e817-4cac-a016-e7e9d847c2b7 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:20:57.720624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 691/1356] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:00.190673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:00.193904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:00.357902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124befc-6c0f-4533-88db-85b6e2361b8a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:00.367092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:00.368110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:00.368583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:00.369024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] PATH_INFO: `/v3/users/4a2c5114e8b148c988598ddc2ce5a2b0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:00.371270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2c5114e8b148c988598ddc2ce5a2b0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:00.376891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:00.417788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:00.471719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2c5114e8b148c988598ddc2ce5a2b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:00.483947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2c5114e8b148c988598ddc2ce5a2b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:00.515598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2c5114e8b148c988598ddc2ce5a2b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:00.516557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2c5114e8b148c988598ddc2ce5a2b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:00.526109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2c5114e8b148c988598ddc2ce5a2b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:00.538302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 666/1357] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:00 2022] DELETE /identity/v3/users/4a2c5114e8b148c988598ddc2ce5a2b0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:00.539941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080533-02ef-4b94-9778-775c1d5870df None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:00.540685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080533-02ef-4b94-9778-775c1d5870df None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:00.540851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080533-02ef-4b94-9778-775c1d5870df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:00.595680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4b080533-02ef-4b94-9778-775c1d5870df None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:00.598150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4b080533-02ef-4b94-9778-775c1d5870df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:00.717353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:00.749193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 692/1358] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:00.821697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:00.825313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:00.860735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00a7a-7089-4f97-a549-5155f560eae9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:00.860735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00a7a-7089-4f97-a549-5155f560eae9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:00.860735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00a7a-7089-4f97-a549-5155f560eae9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:00.861750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 693/1359] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:21:00.924430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:00.924783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:00.925005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:00.979648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:00.981021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:01.059410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2116b2f-e40d-47f7-9d86-f4f82f6df64c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:01.073624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:01.085355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:01.086169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:01.087358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:01.123101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:01.129827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:01.157661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 694/1360] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:01.157915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 667/1361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:01.353772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:01.355518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:01.385803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f63d83-0095-42b6-b740-b8bc62bf5c9c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:01.400162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:01.400827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:01.402605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:01.402740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:01.431092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:01.432962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:01.460488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 695/1362] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:01.870322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:01.873138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:01.899663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3701-2fb0-4db6-9aff-ff9bcc53098b service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:01.916705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:01.919864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:01.920163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:01.920448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] PATH_INFO: `/v3/users/78e787ce17fc46fc800b15c9b647220b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:01.929943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e787ce17fc46fc800b15c9b647220b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:01.940719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:02.091730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e787ce17fc46fc800b15c9b647220b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.123881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e787ce17fc46fc800b15c9b647220b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.148278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e787ce17fc46fc800b15c9b647220b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.151689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e787ce17fc46fc800b15c9b647220b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.173503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7620a540-3d83-4e02-85f7-1fff8372642f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e787ce17fc46fc800b15c9b647220b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.192512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 668/1363] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:01 2022] DELETE /identity/v3/users/78e787ce17fc46fc800b15c9b647220b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:02.425199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:02.427839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:02.466316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4605b-41e5-4cb9-a307-d09c6f95883a service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:02.569171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:02.573612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:02.574157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:02.575075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] PATH_INFO: `/v3/projects/e4a6e0fb608b425fb7754f2369cb39c1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:02.577158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a6e0fb608b425fb7754f2369cb39c1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:02.579284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 19:21:02.579284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 19:21:02.579284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: Oct 31 19:21:02.589503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:02.723751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:02.724415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:02.724964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:02.777731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a6e0fb608b425fb7754f2369cb39c1', 'request_id': 'req-b0cf205d-7f50-4931-9a55-7ce7bc018102'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.802778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:02.829125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] MFA Rules not processed for user `f3bb55041a374035ad251e7706a144c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:02.830480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a6e0fb608b425fb7754f2369cb39c1', 'request_id': 'req-b0cf205d-7f50-4931-9a55-7ce7bc018102'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.834307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:02.885234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a6e0fb608b425fb7754f2369cb39c1', 'request_id': 'req-b0cf205d-7f50-4931-9a55-7ce7bc018102'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.943411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] The token cache is being invalidate because project e4a6e0fb608b425fb7754f2369cb39c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:02.943725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.944445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:02.946028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 696/1364] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:02 2022] DELETE /identity/v3/projects/e4a6e0fb608b425fb7754f2369cb39c1 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:02.950079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:02.957466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:02.970287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:03.088938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 669/1365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:03.100026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:03.101639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:03.220202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf205d-7f50-4931-9a55-7ce7bc018102 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:03.230560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:03.231697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:03.231868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:03.232128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] PATH_INFO: `/v3/users/60e95abf0fce4c8781d21bba42bbd5db` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:03.233447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e95abf0fce4c8781d21bba42bbd5db)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:03.236610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:03.344791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e95abf0fce4c8781d21bba42bbd5db'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.366633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e252-84a0-4b36-9c75-ed1cca15ef1b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:03.367433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e95abf0fce4c8781d21bba42bbd5db'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.385259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e95abf0fce4c8781d21bba42bbd5db'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.397889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e95abf0fce4c8781d21bba42bbd5db'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.398673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e95abf0fce4c8781d21bba42bbd5db'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.405549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:03.409410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:03.410621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 697/1366] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:02 2022] DELETE /identity/v3/users/60e95abf0fce4c8781d21bba42bbd5db => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:03.411147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:03.411465 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:03.413164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:03.414044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:03.428216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:03.461513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:03.463325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:03.502323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 670/1367] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:03.505088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:03.517201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:03.569171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5512f2-d769-46c1-ba28-a2ce8bc9918e service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:03.584330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:03.586659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:03.588263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:03.589996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] PATH_INFO: `/v3/projects/35bad175808b44acb71a290ef40f5a41` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:03.590746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149c1-4d02-404d-8b59-c46b60df4be6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:03.594261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bad175808b44acb71a290ef40f5a41)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:03.601555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:03.605039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:03.606629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:03.607391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:03.610499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] PATH_INFO: `/v3/users/6125c4934d214b399d0a29ac8fb220a7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:03.615023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6125c4934d214b399d0a29ac8fb220a7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:03.619775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:03.695569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:03.731983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bad175808b44acb71a290ef40f5a41', 'request_id': 'req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.750490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6125c4934d214b399d0a29ac8fb220a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.756793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bad175808b44acb71a290ef40f5a41', 'request_id': 'req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.799795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bad175808b44acb71a290ef40f5a41', 'request_id': 'req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.818273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6125c4934d214b399d0a29ac8fb220a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.841473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6125c4934d214b399d0a29ac8fb220a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.844168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] The token cache is being invalidate because project 35bad175808b44acb71a290ef40f5a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:03.844168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.848647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.854009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 671/1368] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:03 2022] DELETE /identity/v3/projects/35bad175808b44acb71a290ef40f5a41 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:03.858860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:03.866897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:03.873226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6125c4934d214b399d0a29ac8fb220a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.873759 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-793317be-d2eb-4f1b-b023-38f67d438d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6125c4934d214b399d0a29ac8fb220a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:03.892403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 698/1369] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:03 2022] DELETE /identity/v3/users/6125c4934d214b399d0a29ac8fb220a7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:03.897496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:03.899348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:03.899714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:03.907247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:03.972613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:03.974066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:04.104992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 699/1370] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:04.126104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e8201-fad6-40c5-bf7c-74a8dcc3eca2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:04.140541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:04.141706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:04.143113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:04.144040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] PATH_INFO: `/v3/users/881050771e4f49d9bfc628b820153bf3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:04.146593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:04.148336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:04.149014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881050771e4f49d9bfc628b820153bf3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:04.154049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:04.271963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c8b4-0800-4c3d-9dc9-405dedaa6b66 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:04.278587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881050771e4f49d9bfc628b820153bf3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.282405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:04.283246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:04.283716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:04.284137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:04.306244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881050771e4f49d9bfc628b820153bf3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.314474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:04.316765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:04.339695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881050771e4f49d9bfc628b820153bf3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.340608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881050771e4f49d9bfc628b820153bf3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.346264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 700/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:04.357304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7673ef5b-047c-4cb7-8346-b967e4b10677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881050771e4f49d9bfc628b820153bf3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.369339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 672/1372] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:03 2022] DELETE /identity/v3/users/881050771e4f49d9bfc628b820153bf3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:04.435766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:04.437451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:04.460367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87be3-1e80-42c5-847f-3dffc009c2fe service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:04.578773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:04.623374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:04.623950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:04.624235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:04.624534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] PATH_INFO: `/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:04.627521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced98eb54b4e4f53948aa2a8198a77fe)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:04.629809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:04.784231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced98eb54b4e4f53948aa2a8198a77fe', 'request_id': 'req-58842f9a-c194-4b0d-b215-a78844b8490c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.812879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced98eb54b4e4f53948aa2a8198a77fe', 'request_id': 'req-58842f9a-c194-4b0d-b215-a78844b8490c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.833140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced98eb54b4e4f53948aa2a8198a77fe', 'request_id': 'req-58842f9a-c194-4b0d-b215-a78844b8490c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.870926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] The token cache is being invalidate because project ced98eb54b4e4f53948aa2a8198a77fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:04.872569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.875392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:04.877349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 701/1373] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:04 2022] DELETE /identity/v3/projects/ced98eb54b4e4f53948aa2a8198a77fe => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:04.883159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b7d0-44a5-4cf7-9b8f-1cf27500db04 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:04.883938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b7d0-44a5-4cf7-9b8f-1cf27500db04 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:04.884304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b7d0-44a5-4cf7-9b8f-1cf27500db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:04.945045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:04.945323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e06b7d0-44a5-4cf7-9b8f-1cf27500db04 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:04.945529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:04.945729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e06b7d0-44a5-4cf7-9b8f-1cf27500db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.074961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58842f9a-c194-4b0d-b215-a78844b8490c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:05.088730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:05.089446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.089767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.090047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] PATH_INFO: `/v3/users/13dd7ff40d334863bc50affb7eb92c7f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.092263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dd7ff40d334863bc50affb7eb92c7f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:05.095213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:05.118303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 673/1374] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:05.131546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.132525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.132525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.174605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:05.179123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.187939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dd7ff40d334863bc50affb7eb92c7f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.198822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 674/1375] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:05.203558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:05.216404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc72c7-a38d-4407-947c-ebc04e455e0b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:05.219239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dd7ff40d334863bc50affb7eb92c7f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.232920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:05.233991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.234695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dd7ff40d334863bc50affb7eb92c7f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.235741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.237504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.238928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:05.241309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:05.244816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:05.247545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:05.255655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dd7ff40d334863bc50affb7eb92c7f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.256763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8a0ab1b8-dcb1-472b-8628-e224f38062fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dd7ff40d334863bc50affb7eb92c7f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.272230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 702/1376] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:04 2022] DELETE /identity/v3/users/13dd7ff40d334863bc50affb7eb92c7f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:05.279549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.280250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.280990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.288575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 675/1377] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:05.292594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:05.298761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.328418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69644-0767-4e3e-a94b-ae7503ad6b42 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:05.329748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:05.335569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.345423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:05.541563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:05.545349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.545516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.548607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.549480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:05.555512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:05.562388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 703/1378] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:05.564410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:05.573635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.621569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d7d3-810d-408c-ac5a-625c4e32cec4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:05.645212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:05.647238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.648064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.650757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] PATH_INFO: `/v3/projects/16971e18aa734019aaf880bbb8460e3c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.654099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16971e18aa734019aaf880bbb8460e3c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:05.659266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:05.659497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 676/1379] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:05 2022] POST /identity/v3/projects => generated 371 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:05.662351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:05.667134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.792515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16971e18aa734019aaf880bbb8460e3c', 'request_id': 'req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.802980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16971e18aa734019aaf880bbb8460e3c', 'request_id': 'req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.814188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16971e18aa734019aaf880bbb8460e3c', 'request_id': 'req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.825431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81e53-a842-4191-baaf-8414c1a42609 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:05.847053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] The token cache is being invalidate because project 16971e18aa734019aaf880bbb8460e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:05.849744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.851025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:05.859308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 704/1380] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:05 2022] DELETE /identity/v3/projects/16971e18aa734019aaf880bbb8460e3c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:05.861912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:05.865260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:05.948905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:05.950679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:05.960687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:05.961965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:05.966993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.070920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473f2bc-a7fb-4d8f-a5bf-7f5572154dc6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:06.080698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:06.081590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.081975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.082546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.083412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.086927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037559-a024-4051-8bed-7d6c33240d9f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.102401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.112649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfae99b-740d-441e-a99c-a041814f8ab3 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.137854 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:06.138440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 705/1381] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:05 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:06.146403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.148992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 677/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:06.150795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.151351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.153517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.154110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.161143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.263243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:06.270197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.294445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] MFA Rules not processed for user `fd2e5a20bdeb4fe3abe152d2abbe9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:06.296993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.297601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 706/1383] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:06.304919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.331485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:06.370059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fbb36-fc17-42ba-b7fb-ad1ac76c77de None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:06.387056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:06.390143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.392750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.393550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.399201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.410494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f577aba-98d3-49f1-b85f-ce274b62abc2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.455194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 707/1384] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:06.461080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.463988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.464437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.518654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:06.520625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.533118 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 708/1385] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:06.534203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.538473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.585006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f2388-efcb-406d-931a-c0e3e5dcb784 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:06.591007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 678/1386] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:06.592314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.594213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:06.595339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.595991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.596662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] PATH_INFO: `/v3/projects/591ab91eb27a4c679957fd8edf8a4de1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.598850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=591ab91eb27a4c679957fd8edf8a4de1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.633939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.641603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70545092-3e68-4113-8c19-d6ebde646e68 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:06.649810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:06.650783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.651252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.651717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.668215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.670194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.705620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 679/1387] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:06.706715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.718906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c162-392e-4db3-a5f0-122a789b80a3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:06.724708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:06.726412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.726791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.727169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.731452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:06.732270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:06.739175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb3aa4-c629-4f2a-9f15-159b6ba316ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:06.758445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 680/1388] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:06.759774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:06.760130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:06.760521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:06.790678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] MFA Rules not processed for user `fd2e5a20bdeb4fe3abe152d2abbe9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:06.792634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.839119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591ab91eb27a4c679957fd8edf8a4de1', 'request_id': 'req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:06.854336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591ab91eb27a4c679957fd8edf8a4de1', 'request_id': 'req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:06.865487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591ab91eb27a4c679957fd8edf8a4de1', 'request_id': 'req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:06.893883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] The token cache is being invalidate because project 591ab91eb27a4c679957fd8edf8a4de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:06.894697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:06.899761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:06.904283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 709/1389] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:06 2022] DELETE /identity/v3/projects/591ab91eb27a4c679957fd8edf8a4de1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:06.905209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.910857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:06.947880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 681/1390] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:06.949328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:06.962824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.111322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb46ca-915e-40e2-9a7f-a48d1f2cca1e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:07.127476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:07.128181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.129020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.129722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] PATH_INFO: `/v3/projects/c40c5543296e4dbf9bd07f660b7e05c4/users/f9466618df9d45c997d1b667301c9561/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.150256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05240d02-020f-4512-80f1-0012eed2e0aa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:07.155656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:07.156495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.156929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.157205 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.158446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:07.161524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:07.195996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40c5543296e4dbf9bd07f660b7e05c4, user_id=f9466618df9d45c997d1b667301c9561, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:07.203074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdef45-d436-473c-8b47-ba146174ff06 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:07.215967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:07.238383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 710/1391] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:06 2022] PUT /identity/v3/projects/c40c5543296e4dbf9bd07f660b7e05c4/users/f9466618df9d45c997d1b667301c9561/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:07.242898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 682/1392] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:06 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:07.243852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:07.247687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.252323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.255147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.263032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.331917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:07.333194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.437064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809120bf-8dba-4593-be5d-065b102129d4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:07.453099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:07.453797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.454123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.454399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.457268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:07.457954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.491758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 711/1393] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:07.500403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:07.520391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa321-4a69-4c92-9f9e-d5a7817d483f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:07.533595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:07.537469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.537834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.541387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.544545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:07.556549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:07.585544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:07.587549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3d86-1d47-482f-bb06-c9a3e4905f9c service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:07.599554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 683/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:07.600898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443d679-b9f3-4909-a8e3-c5cd4235bca6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.601192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443d679-b9f3-4909-a8e3-c5cd4235bca6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.601514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443d679-b9f3-4909-a8e3-c5cd4235bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.606635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 712/1395] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:07 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:07.607865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:07.613893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.641071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34489149-bb13-4059-844a-86429b3b085f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:07.645310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1443d679-b9f3-4909-a8e3-c5cd4235bca6 None None] MFA Rules not processed for user `f9466618df9d45c997d1b667301c9561`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:07.646636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1443d679-b9f3-4909-a8e3-c5cd4235bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.649038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:07.649985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.650962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.651462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] PATH_INFO: `/v3/projects/f1f9b7becc454dac95ff6bd7fcc40972` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.654121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f9b7becc454dac95ff6bd7fcc40972)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:07.658349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:07.740498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f9b7becc454dac95ff6bd7fcc40972', 'request_id': 'req-8e7faf0f-d620-4777-a69f-cb6e3b11f763'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:07.757654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f9b7becc454dac95ff6bd7fcc40972', 'request_id': 'req-8e7faf0f-d620-4777-a69f-cb6e3b11f763'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:07.775236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 684/1396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:07.780594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:07.780890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:07.782386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:07.785375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f9b7becc454dac95ff6bd7fcc40972', 'request_id': 'req-8e7faf0f-d620-4777-a69f-cb6e3b11f763'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:07.821743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] The token cache is being invalidate because project f1f9b7becc454dac95ff6bd7fcc40972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:07.821743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:07.828359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:07.836685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:07.836818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:07.885953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 713/1397] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:07 2022] DELETE /identity/v3/projects/f1f9b7becc454dac95ff6bd7fcc40972 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:07.888149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:07.890778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:07.894784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.010329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 685/1398] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:08.011510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.015418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.037277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cbfc8-ec1a-48b5-b9f6-cb275db6df77 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.042983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.043851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf0f-d620-4777-a69f-cb6e3b11f763 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.045614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.046280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.046643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.048947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.051398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.052216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.053969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.054255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.054533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.055206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.060632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8ca3b-d0f6-44c2-8a38-bbdf9ab4f5e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.097985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 714/1399] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:08.097985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.097985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.097985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.110031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 686/1400] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:08 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:08.116472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.118424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.189620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] MFA Rules not processed for user `7f29a88591064a67bdb7644471beeb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:08.191626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.262181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703644-df96-46b2-9a9c-05a9b5254d14 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.270934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.271863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.272303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.272748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] PATH_INFO: `/v3/users/aa014db5dfd24bcc9c26153a20e52045` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.274295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa014db5dfd24bcc9c26153a20e52045)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.278765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.327603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:08.381930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 715/1401] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:08.382991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.392002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa014db5dfd24bcc9c26153a20e52045'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:08.408064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c5b90-1eef-4a7e-9688-ae04551a57d1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.408803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa014db5dfd24bcc9c26153a20e52045'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:08.426564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.428926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.432091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.433978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.434757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:08.435136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.442266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.449934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa014db5dfd24bcc9c26153a20e52045'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:08.450762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa014db5dfd24bcc9c26153a20e52045'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:08.468711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa014db5dfd24bcc9c26153a20e52045'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:08.476434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 716/1402] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:08.478011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.483176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.488392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 687/1403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:08 2022] DELETE /identity/v3/users/aa014db5dfd24bcc9c26153a20e52045 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:08.489484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.497598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.509091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ea8f-aa60-45d1-a718-ae264090f7e4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.551691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:08.649075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.650948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647db2b-cf2c-4e3e-b4a1-00e237c1e782 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.651347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.651635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.651915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.653181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.654975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.660973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.663236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.663625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.668913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.669777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.670255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 717/1404] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:08.671152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.672206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.673094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.720243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 688/1405] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:08 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:08.721282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.728255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.752968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ef60b-d367-411f-bc10-b598a837191b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.764867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.765646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.766026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.766398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.768347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.776879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.796099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb494e-3c04-414d-bb1f-42ccb4b7cbf2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.805606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.806792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.807088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.807490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.810813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:08.855276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 689/1406] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:08 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:08.855276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:08.963528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:08.964894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834403-f5e7-4a9e-af20-38c411997be2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:08.966134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:08.971766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:08.972692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:08.973036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:08.973382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] PATH_INFO: `/v3/projects/816fcc5c31ae4e15ac7097eab418e55b/users/947eb82557414f2ba0a4187a8ca87a70/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:08.984174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 718/1407] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:08.986617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.002456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:09.013686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816fcc5c31ae4e15ac7097eab418e55b, user_id=947eb82557414f2ba0a4187a8ca87a70, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.014692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e599d7-5ff7-4ec6-9547-ee07a756e7b8 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.023261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d48f5-dc20-4212-8ef9-3dedbfcd93c6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.028538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.029572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.029572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.029766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.030387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.032181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.055497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 690/1408] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:08 2022] PUT /identity/v3/projects/816fcc5c31ae4e15ac7097eab418e55b/users/947eb82557414f2ba0a4187a8ca87a70/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:09.058416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5d8c-d45b-41f7-8fdd-99a6713cbac9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.060067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5d8c-d45b-41f7-8fdd-99a6713cbac9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.060518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5d8c-d45b-41f7-8fdd-99a6713cbac9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.068226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 719/1409] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:09.068804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 691/1410] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 19:21:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:21:09.069504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.076448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b35-c0fe-4816-a053-b9abcc6fb9dc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.077525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b35-c0fe-4816-a053-b9abcc6fb9dc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.078237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b35-c0fe-4816-a053-b9abcc6fb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.092067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1ad8-469e-44f2-a976-82ff952cf76e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.128024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d5734b35-c0fe-4816-a053-b9abcc6fb9dc None None] MFA Rules not processed for user `5f1b3a50127f4548a20907a9c42b889d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:09.130129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d5734b35-c0fe-4816-a053-b9abcc6fb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.186545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.188367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.188367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.188367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.188950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.192541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50c768-0308-4791-adf3-b5d1d5a44990 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.219750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:09.226914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 692/1411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:09.230514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.230696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 720/1412] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:09.231592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.232011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.232428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.232868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.233549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.302774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] MFA Rules not processed for user `947eb82557414f2ba0a4187a8ca87a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:09.308364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.315295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:09.317139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.394733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 721/1413] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:09.395906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.433483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ab93-e819-41cf-b7f0-03dded9b315a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.442311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.443160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.443492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.443851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] PATH_INFO: `/v3/projects/de25d1aae6604463b116acd4291ea77b/users/c74460589e1a4d6b910e33f7870e9f8f/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.464729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de25d1aae6604463b116acd4291ea77b, user_id=c74460589e1a4d6b910e33f7870e9f8f, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.469053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9dacf-5610-40aa-9b42-f60ddbbc0778 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.473767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 693/1414] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:09.477686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.491710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 722/1415] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:09 2022] PUT /identity/v3/projects/de25d1aae6604463b116acd4291ea77b/users/c74460589e1a4d6b910e33f7870e9f8f/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:09.493128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.493441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.493714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.494010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda131d1-dfa6-4abf-9964-a8fee1f5197b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.530064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] MFA Rules not processed for user `5f1b3a50127f4548a20907a9c42b889d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:09.531703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.593712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.594775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.595195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.596405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.599615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.603293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.628027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:09.636693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 694/1416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:09.636693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.639807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.645995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 723/1417] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:09.647886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.649686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.663927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bac54-4814-4268-b304-a0c68f5ead4b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.683526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.684753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.685274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.685714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] PATH_INFO: `/v3/projects/18fd4d5700474500bf3f83062c84c601` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.690089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fd4d5700474500bf3f83062c84c601)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.693261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.759809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bc488-a408-4464-a80b-07e6a595f0a1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.767642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:09.768407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:09.769779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:09.770133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:09.787496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:09.789373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:09.802250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 724/1418] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:09.804442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.829177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fd4d5700474500bf3f83062c84c601', 'request_id': 'req-d57115e4-3722-427e-9dcf-a54f962e08ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:09.842059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fd4d5700474500bf3f83062c84c601', 'request_id': 'req-d57115e4-3722-427e-9dcf-a54f962e08ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:09.852438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fd4d5700474500bf3f83062c84c601', 'request_id': 'req-d57115e4-3722-427e-9dcf-a54f962e08ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:09.879816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] The token cache is being invalidate because project 18fd4d5700474500bf3f83062c84c601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:09.879816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:09.879816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:09.881236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 695/1419] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:09 2022] DELETE /identity/v3/projects/18fd4d5700474500bf3f83062c84c601 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:09.887100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:09.897426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:09.902322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9756e5-7cce-4fb9-8332-96c709d99e45 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:09.919136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:10.055201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57115e4-3722-427e-9dcf-a54f962e08ce admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.067697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.068266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.068587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.068866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.069576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.071371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.091114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.091761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.092044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.092321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.093326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.095397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.103661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 696/1420] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:10.105392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.113418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.145968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 725/1421] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:09 2022] POST /identity/v3/projects => generated 385 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:10.151361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.154186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407eae6-6bcd-4591-8bc6-607329027e91 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.160312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.271987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.272946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.273398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.273816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.274975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.279077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe9e8-eac2-4996-88b3-d773e503d0f2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.286328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44386-908f-420f-a898-748e958287c4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.298338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 697/1422] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:10.299914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.301883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7d4-b882-41bc-896c-2473195860c7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.302340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7d4-b882-41bc-896c-2473195860c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.303723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.303723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.303723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.305007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c7d4-b882-41bc-896c-2473195860c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.326928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.334856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-16d9c7d4-b882-41bc-896c-2473195860c7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:10.337264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-16d9c7d4-b882-41bc-896c-2473195860c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.350167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 698/1423] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:10.357268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.357268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.357268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.385678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:10.411728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] MFA Rules not processed for user `f3bb55041a374035ad251e7706a144c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:10.415244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.503319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.509520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.540965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 726/1424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:10.542178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.568192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a87d0-308f-4a8a-8205-3ac97651631d service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.576604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 699/1425] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:10.580133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.586519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.587047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.587328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.587602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] PATH_INFO: `/v3/projects/de25d1aae6604463b116acd4291ea77b/users/c74460589e1a4d6b910e33f7870e9f8f/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.591463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.599994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de25d1aae6604463b116acd4291ea77b, user_id=c74460589e1a4d6b910e33f7870e9f8f, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.614450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828e4f-0c79-403c-9782-238064c4bf49 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.620816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cad00-d102-432f-a851-6651fc901737 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.627456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.628444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.628839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.629116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.629821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.632980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.664424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 700/1426] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:10 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:10.665670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.669378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 727/1427] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:10 2022] PUT /identity/v3/projects/de25d1aae6604463b116acd4291ea77b/users/c74460589e1a4d6b910e33f7870e9f8f/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:10.681038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.681243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.681462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.690264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d3e79-d7d8-4f5b-9cbe-df6d3b4cfaa1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.712635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:10.715126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:10.738425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:10.827238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.827930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.828207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.829097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] PATH_INFO: `/v3/projects/dd937508c9204dd582751f1f75b78813/users/f6156a6f25fb445396956ab12a27c525/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.848635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 728/1428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:10.849678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.865661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd937508c9204dd582751f1f75b78813, user_id=f6156a6f25fb445396956ab12a27c525, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.868378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0eae9-a867-4601-8c5f-7e4a4d44471d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.869155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08396-6177-402f-b09e-21c23a6f421a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.880568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:10.885749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.886080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.888265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.889007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:10.893153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:10.896436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 701/1429] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:10 2022] PUT /identity/v3/projects/dd937508c9204dd582751f1f75b78813/users/f6156a6f25fb445396956ab12a27c525/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:10.897667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bcf93-e4d9-4855-b183-38048b384853 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:10.897951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bcf93-e4d9-4855-b183-38048b384853 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:10.898221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bcf93-e4d9-4855-b183-38048b384853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:10.926848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 729/1430] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:10.928796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:10.950999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084ff34-eca2-4698-ac8b-c690a37fab02 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:10.955222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-614bcf93-e4d9-4855-b183-38048b384853 None None] MFA Rules not processed for user `c74460589e1a4d6b910e33f7870e9f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:10.956740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-614bcf93-e4d9-4855-b183-38048b384853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:11.079393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.080166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.080885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.081873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.083714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:11.084367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.086903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.121183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 702/1431] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:11.122716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.123007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.123287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.136182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 730/1432] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:11.137280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.160188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ff97b-01c2-43a0-a5fa-3f3d343486f2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.173989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.174626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.174907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.176746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.177405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.179017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.197216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] MFA Rules not processed for user `f6156a6f25fb445396956ab12a27c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:11.198444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:11.205805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 731/1433] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:11.207531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.210969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:11.293674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:11.370412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 703/1434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:11.375915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.377971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:11.386135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967add3-4785-49d9-a6d2-09384c6ef07a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.392517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.393378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.394381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.394610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.399542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:11.418805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:11.427159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.433044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.446177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 732/1435] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:11.447194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.461142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c44d6-db2c-4548-b38d-3b94e66717dd service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.467481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.468419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.468921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.469298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.470353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.473498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.479681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8f6d-1ef3-487f-ae32-cd2e6cd8b38b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.491151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.492736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.493168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.493671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.509898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.511523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.560314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 733/1436] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:11 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:11.561909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.582884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 704/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:11.584031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.621554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8bcd-18b6-4640-ba70-990f45b392cb service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.805304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a12efd-4248-4845-9478-389fe36ae726 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:11.821256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.822894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.825820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.826114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] PATH_INFO: `/v3/projects/ab06d8f24e0c4a1aa5c7935665cbc227/users/664e451bc01d40529184868867501d56/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.857187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:11.857815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.858096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.858369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.859013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.860987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8c30e-6b55-46c9-8d7e-cc8fa7effd41 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.875097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab06d8f24e0c4a1aa5c7935665cbc227, user_id=664e451bc01d40529184868867501d56, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:11.883988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:11.910041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 705/1438] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:11 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:11.920593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 734/1439] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:11 2022] PUT /identity/v3/projects/ab06d8f24e0c4a1aa5c7935665cbc227/users/664e451bc01d40529184868867501d56/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:11.920593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:11.920829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046302b8-810d-4a36-b26c-c9cc5208d518 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:11.920829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046302b8-810d-4a36-b26c-c9cc5208d518 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:11.920829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046302b8-810d-4a36-b26c-c9cc5208d518 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:11.920829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 706/1440] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 31 19:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:21:11.920829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046302b8-810d-4a36-b26c-c9cc5208d518 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.064928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ad9e-96ba-47cb-8a3d-e745a4508b60 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.077618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046302b8-810d-4a36-b26c-c9cc5208d518 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.080706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.082047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.083608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.083914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.084608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.085009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.086432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.086767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.087148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.087370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd4d67-2632-42a0-b63d-2686d41f7194 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.088045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.091056 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b512ed-ff7c-49c3-b804-12dd3300736a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.142565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 707/1441] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:11 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:12.142565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.144632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.145141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.145705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 735/1442] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:11 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:12.149526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.150683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.150979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.171942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:12.214058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] MFA Rules not processed for user `664e451bc01d40529184868867501d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:12.217470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.219764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:12.226816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.282616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:12.350466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 736/1443] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:12.364929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.385057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 708/1444] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:12.386607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.389715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96aa61-c66e-4613-b074-4b5dd2f42a1f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.399223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.400407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.402192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.402668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.405357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.408372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.414324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0dc51-73a2-4ca7-948f-b939bae5627e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.428146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.428935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.429395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.429687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.430406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.435461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.437462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 737/1445] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:12.439237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.445362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.460514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 709/1446] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:12.460514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.472747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659963-b081-4d84-af8d-2bd7ca402307 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.474822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fc455-079c-4195-9176-a76c5e585f49 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.479431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.480481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.480931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.481281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] PATH_INFO: `/v3/users/f9466618df9d45c997d1b667301c9561` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.483303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9466618df9d45c997d1b667301c9561)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.485070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.486759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.486969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.488594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.489099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.513599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.515664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.536696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 738/1447] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:12.540004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.575772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8873d-be5a-4639-8b65-175d11b47a5e service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.602377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.602940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.603225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.604032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.604144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.607504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9466618df9d45c997d1b667301c9561'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:12.609495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.617824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9466618df9d45c997d1b667301c9561'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:12.638299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9466618df9d45c997d1b667301c9561'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:12.639060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9466618df9d45c997d1b667301c9561'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:12.650343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9466618df9d45c997d1b667301c9561'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:12.664551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 710/1448] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:12 2022] DELETE /identity/v3/users/f9466618df9d45c997d1b667301c9561 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:12.665843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.667705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.694283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 739/1449] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:12 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:12.694283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:12.695835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.858213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34b08e-ffcb-4ba7-965f-2e1acf1b1973 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.871319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.872954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.873976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.874515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.876486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.881595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063bc3-95eb-417d-9d69-7d26c0dc54fc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:12.910976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 740/1450] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:12.918534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.919831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.922393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.928678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edebd35-de71-4a4a-b716-92b982b04ae7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:12.941346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:12.945405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:12.945405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:12.945405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] PATH_INFO: `/v3/projects/3ba82581e3d34484a6de688227e6c2f7/users/2a7b8f63fc804c6c967c5f6fda2a0f15/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:12.971238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:12.972728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:12.981116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba82581e3d34484a6de688227e6c2f7, user_id=2a7b8f63fc804c6c967c5f6fda2a0f15, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:12.987352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:13.014125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 741/1451] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:13.015148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:13.026339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:13.029582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 711/1452] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:12 2022] PUT /identity/v3/projects/3ba82581e3d34484a6de688227e6c2f7/users/2a7b8f63fc804c6c967c5f6fda2a0f15/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:13.031194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:13.070178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac98dc2-86e9-4b09-83a5-f8626f301abe None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:13.096346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:13.265167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:13.285215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:13.285859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.286141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.286424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.291704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:13.295585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12aea-e092-4c6a-a0fa-a13eb9a2b284 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:13.296954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:13.305038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:13.306886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.307841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.308337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] PATH_INFO: `/v3/projects/c4cc22bc0db140068e5e9582e665050e/users/f66ef9102cb045b78c560596918d29dd/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.364099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 742/1453] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:13 2022] POST /identity/v3/users => generated 299 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:13.364099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:13.370793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc22bc0db140068e5e9582e665050e, user_id=f66ef9102cb045b78c560596918d29dd, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:13.375322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:13.387662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fec5c-5379-4035-971e-39ae67af21f6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:13.397050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:13.400288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.402402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.403182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.403929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:13.408657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 712/1454] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:13 2022] PUT /identity/v3/projects/c4cc22bc0db140068e5e9582e665050e/users/f66ef9102cb045b78c560596918d29dd/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:13.408657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:13.409268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e23f4f-d642-48b0-b9d2-8e7f572d8427 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:13.416354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:13.430690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 743/1455] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:13.455373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.468800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.470290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.568653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] MFA Rules not processed for user `fd2e5a20bdeb4fe3abe152d2abbe9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:13.575562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:13.626398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df028d-130a-4660-9d2e-8c53fb847733 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:13.641785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:13.642828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.643007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.643264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.788158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 744/1456] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:13.789257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:13.851837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:13.853603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9b15b-ce63-4994-b5ee-c8bf88bc0328 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:13.887900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 713/1457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:13.891255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d42b-cefa-43a3-ad14-7baae2b68340 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:13.891547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d42b-cefa-43a3-ad14-7baae2b68340 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:13.891821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986d42b-cefa-43a3-ad14-7baae2b68340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:13.989962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e986d42b-cefa-43a3-ad14-7baae2b68340 None None] MFA Rules not processed for user `f66ef9102cb045b78c560596918d29dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:13.996174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e986d42b-cefa-43a3-ad14-7baae2b68340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:14.009884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e8c6-c3e3-46e6-b919-ad74cfd70e78 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:14.036957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:14.040604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.041062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.041658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:14.049003 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:14.051486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:14.086266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 745/1458] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:14.087461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:14.150331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe5eb-88f0-49ed-a386-eb415a32df0f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:14.173511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:14.174329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.174713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.176683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] PATH_INFO: `/v3/projects/3ba82581e3d34484a6de688227e6c2f7/users/2a7b8f63fc804c6c967c5f6fda2a0f15/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:14.185313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba82581e3d34484a6de688227e6c2f7, user_id=2a7b8f63fc804c6c967c5f6fda2a0f15, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:14.193189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:14.223650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 746/1459] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:14 2022] PUT /identity/v3/projects/3ba82581e3d34484a6de688227e6c2f7/users/2a7b8f63fc804c6c967c5f6fda2a0f15/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:14.226518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:14.235356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:14.315884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 714/1460] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:14.315884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce04b-01d9-433b-b6cf-ac6d21fd1394 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.315884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce04b-01d9-433b-b6cf-ac6d21fd1394 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.315884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce04b-01d9-433b-b6cf-ac6d21fd1394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:14.381181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-76dce04b-01d9-433b-b6cf-ac6d21fd1394 None None] MFA Rules not processed for user `2a7b8f63fc804c6c967c5f6fda2a0f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:14.382484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-76dce04b-01d9-433b-b6cf-ac6d21fd1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:14.411614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676ea3-8aa3-43f3-8d16-e0b32eab62ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:14.418710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:14.419739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.420541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.421662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] PATH_INFO: `/v3/projects/146ed97d51b048a0af67ac7886117a00/users/3a4b479e21f3467f93272b78376ddb04/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:14.433593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:14.493531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146ed97d51b048a0af67ac7886117a00, user_id=3a4b479e21f3467f93272b78376ddb04, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:14.503045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:14.589641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 747/1461] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:14 2022] PUT /identity/v3/projects/146ed97d51b048a0af67ac7886117a00/users/3a4b479e21f3467f93272b78376ddb04/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:14.596384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:14.607170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:14.646727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 715/1462] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:14.654909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.655571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.656924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:14.722737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] MFA Rules not processed for user `7f29a88591064a67bdb7644471beeb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:14.729000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:14.854853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 716/1463] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:14.854853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:14.890948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af975a-9fdd-493b-9b7f-8e760a35b9e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:14.905896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:14.906666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:14.908244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:14.908769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.014636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.017820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.035860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 748/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:15.037046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:15.038454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:15.064174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2383b-7eb1-4b86-853a-392667997d59 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:15.065359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a775-069e-4688-bab1-8c2bb725bc34 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:15.070253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:15.071038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.071329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.071702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.080002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:15.080917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.082019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.082921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.083742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.085565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.095290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:15.118697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 717/1465] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:15.122631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:15.156618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be2ba-bb09-44a6-a020-97d5ad614a9e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:15.183725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:15.184412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.184881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.185169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] PATH_INFO: `/v3/projects/146ed97d51b048a0af67ac7886117a00/users/3a4b479e21f3467f93272b78376ddb04/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.193587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146ed97d51b048a0af67ac7886117a00, user_id=3a4b479e21f3467f93272b78376ddb04, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.196254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e03b3f-5203-459a-8c2d-83f84bd1ab82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.220251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.225879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.236900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 718/1466] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:15 2022] PUT /identity/v3/projects/146ed97d51b048a0af67ac7886117a00/users/3a4b479e21f3467f93272b78376ddb04/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:15.248717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.249007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.249292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.270954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 749/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:15.348630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] MFA Rules not processed for user `3a4b479e21f3467f93272b78376ddb04`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:15.349893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:15.417810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:15.434195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2c33-4386-44b1-ba4d-09c444e1642c service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:15.512710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 719/1468] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:15.528502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:15.562748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:15.696304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:15.696961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.697250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.697555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] PATH_INFO: `/v3/users/f6156a6f25fb445396956ab12a27c525` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.713603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6156a6f25fb445396956ab12a27c525)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.715618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.820601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8752e9-38af-4b69-a6c9-3a794f461b96 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:15.834265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:15.834902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.835187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.835463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.869322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:15.877154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677abfb-705a-4d45-b85b-1ba3b8953539 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:15.905209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6156a6f25fb445396956ab12a27c525'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:15.919016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 720/1469] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:15.921579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171558ac-1231-4a9e-a2a1-457ea58535e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:15.922537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171558ac-1231-4a9e-a2a1-457ea58535e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:15.922847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171558ac-1231-4a9e-a2a1-457ea58535e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:15.977499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6156a6f25fb445396956ab12a27c525'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.042616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6156a6f25fb445396956ab12a27c525'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.067054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6156a6f25fb445396956ab12a27c525'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.068004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6156a6f25fb445396956ab12a27c525'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.078556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 750/1470] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:15 2022] DELETE /identity/v3/users/f6156a6f25fb445396956ab12a27c525 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:16.079746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:16.084793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:16.189717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-171558ac-1231-4a9e-a2a1-457ea58535e8 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:16.191510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-171558ac-1231-4a9e-a2a1-457ea58535e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:16.331056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839313-37fc-4a88-a640-7f30c2bce8b3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:16.343483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:16.344147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:16.344423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:16.344723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] PATH_INFO: `/v3/projects/c40c5543296e4dbf9bd07f660b7e05c4` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:16.349429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40c5543296e4dbf9bd07f660b7e05c4)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:16.351852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:16.441845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:16.499751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40c5543296e4dbf9bd07f660b7e05c4', 'request_id': 'req-23151720-b0c1-4995-bf55-0edd51516638'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.513314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:16.521552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40c5543296e4dbf9bd07f660b7e05c4', 'request_id': 'req-23151720-b0c1-4995-bf55-0edd51516638'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.553689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 721/1471] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:21:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 634 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:16.557352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:16.558194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40c5543296e4dbf9bd07f660b7e05c4', 'request_id': 'req-23151720-b0c1-4995-bf55-0edd51516638'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.573228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:16.573624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:16.618545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] The token cache is being invalidate because project c40c5543296e4dbf9bd07f660b7e05c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:16.619025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.622362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:16.624787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 751/1472] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:16 2022] DELETE /identity/v3/projects/c40c5543296e4dbf9bd07f660b7e05c4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:16.641632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:16.644755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:16.652307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:16.660652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:16.900204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151720-b0c1-4995-bf55-0edd51516638 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:16.916100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:16.916733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:16.917031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:16.917355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] PATH_INFO: `/v3/users/c74460589e1a4d6b910e33f7870e9f8f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:16.919092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74460589e1a4d6b910e33f7870e9f8f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:16.930609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 722/1473] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:16.933851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:16.934453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:16.936944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:17.046876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74460589e1a4d6b910e33f7870e9f8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:17.132757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74460589e1a4d6b910e33f7870e9f8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:17.151450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74460589e1a4d6b910e33f7870e9f8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:17.167550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74460589e1a4d6b910e33f7870e9f8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:17.168822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74460589e1a4d6b910e33f7870e9f8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:17.187685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 752/1474] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:16 2022] DELETE /identity/v3/users/c74460589e1a4d6b910e33f7870e9f8f => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:17.188570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:17.192913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:17.343727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c3ce2-ea15-471c-b4d5-fbdb41d7af07 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:17.397658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81063-685f-4c34-8953-2f499505a309 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:17.422473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:17.423119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:17.423403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:17.423677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:17.431726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:17.482259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:17.483008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:17.483289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:17.483558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:17.493373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:17.494178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:17.541753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:17.657094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:17.660878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:17.674363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 753/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:17.675637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:17.677197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:17.707553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:17.711792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd40aa-a69f-432d-847a-1d0f19075399 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:17.737029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 723/1476] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:21:17.822605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b8350-aacb-4da4-9439-88cdab19131b service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:17.832427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:17.835454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:17.836922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:17.837430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:17.842262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:18.045541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:18.048652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:18.091359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 754/1477] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:19.953625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:19.954616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:19.955055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:20.009207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:20.010443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:20.040950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 724/1478] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Oct 31 19:21:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:20.200152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:20.207431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:20.245189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d460-2a42-4f10-a4ef-60bad24115a9 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:20.264197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:20.265245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:20.265579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:20.265860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:20.291284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:20.293023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:20.322335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 755/1479] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:21.039774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:21.041499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:21.064450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:21.066030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:21.076050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aac4bf-4a8c-4507-88b6-6dbfd26805e4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:21.088386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:21.089226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.091408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.094284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] PATH_INFO: `/v3/projects/de25d1aae6604463b116acd4291ea77b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.103322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de25d1aae6604463b116acd4291ea77b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:21.106272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:21.110787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fd32e-d4f5-4d20-98a3-81d5139b1375 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:21.133304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:21.133850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.134134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.134410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] PATH_INFO: `/v3/projects/dd937508c9204dd582751f1f75b78813` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.135665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd937508c9204dd582751f1f75b78813)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:21.137706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:21.268377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de25d1aae6604463b116acd4291ea77b', 'request_id': 'req-f4c8e481-f0ca-480d-bb23-a70de48c0123'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.294928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:21.296354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de25d1aae6604463b116acd4291ea77b', 'request_id': 'req-f4c8e481-f0ca-480d-bb23-a70de48c0123'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.304708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd937508c9204dd582751f1f75b78813', 'request_id': 'req-12c00b0e-16a0-40d0-a678-a7512299044b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.323345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de25d1aae6604463b116acd4291ea77b', 'request_id': 'req-f4c8e481-f0ca-480d-bb23-a70de48c0123'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.340123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd937508c9204dd582751f1f75b78813', 'request_id': 'req-12c00b0e-16a0-40d0-a678-a7512299044b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.358777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd937508c9204dd582751f1f75b78813', 'request_id': 'req-12c00b0e-16a0-40d0-a678-a7512299044b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.392724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] The token cache is being invalidate because project de25d1aae6604463b116acd4291ea77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:21.393029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.399755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] The token cache is being invalidate because project dd937508c9204dd582751f1f75b78813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:21.406141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.408389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.409788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f4c8e481-f0ca-480d-bb23-a70de48c0123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.411198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 756/1480] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:21 2022] DELETE /identity/v3/projects/dd937508c9204dd582751f1f75b78813 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:21.418775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 725/1481] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:21 2022] DELETE /identity/v3/projects/de25d1aae6604463b116acd4291ea77b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:21.423905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1276-bd3c-42d1-af36-20d5303dc774 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.424200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1276-bd3c-42d1-af36-20d5303dc774 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.424501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f1276-bd3c-42d1-af36-20d5303dc774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.434541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:21.443889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:21.515802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-599f1276-bd3c-42d1-af36-20d5303dc774 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:21.517095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-599f1276-bd3c-42d1-af36-20d5303dc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:21.695091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00b0e-16a0-40d0-a678-a7512299044b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:21.708171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:21.709191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.712540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.713075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] PATH_INFO: `/v3/users/2a7b8f63fc804c6c967c5f6fda2a0f15` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.716015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7b8f63fc804c6c967c5f6fda2a0f15)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:21.718861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:21.778402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 726/1482] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:21.782128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.786071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.788090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.880116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:21.883897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:21.914641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 727/1483] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:21.916934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:21.920149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7b8f63fc804c6c967c5f6fda2a0f15'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:21.942707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856d063-cb03-4da5-ae4d-f3f87faa0053 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:21.967096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:21.969625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:21.969915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:21.970203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:21.973280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:21.974392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:21.979171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:21.999011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7b8f63fc804c6c967c5f6fda2a0f15'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:22.020071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 728/1484] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:22.025090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:22.033134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7b8f63fc804c6c967c5f6fda2a0f15'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:22.051534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18544-0f19-4f90-801e-4e7781bd2571 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:22.060517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7b8f63fc804c6c967c5f6fda2a0f15'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:22.061200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7b8f63fc804c6c967c5f6fda2a0f15'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:22.077171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:22.077945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:22.082727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:22.083105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 757/1485] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:21 2022] DELETE /identity/v3/users/2a7b8f63fc804c6c967c5f6fda2a0f15 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:22.084101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:22.084994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:22.091755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:22.107909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:22.164673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 729/1486] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:22 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:22.169148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:22.170704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:22.450388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:22.465225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e510-ceb7-42cb-8d99-fba0f784ae7f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:22.721895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:22.722907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:22.723356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:22.723953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:22.725169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:22.728362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:22.776978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 758/1487] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:22 2022] POST /identity/v3/users => generated 283 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:22.780822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:22.803384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d433-0421-4b64-8e95-db78e7f38981 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:22.814660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:22.815590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:22.816057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:22.816448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:22.817364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:22.819232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:22.842818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 730/1488] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:22.846035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:22.862578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a645d6-2315-4039-921c-0434d6e486db admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:22.917294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:22.917935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:22.918223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:22.933219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:22.952476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:22.968323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad116e1-8dd3-4a6a-8da4-fad6bd46c44c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:23.082518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 759/1489] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:23.083799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:23.110985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee57c7-a76e-4f72-b689-0f8c79217c94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:23.147031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:23.160375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:23.160375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:23.160375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] PATH_INFO: `/v3/projects/8fcc45b591314bb4a6fb657cf7d00b93/users/52b5aad98fa04fd3bd46cfe26c0b47d5/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:23.240778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcc45b591314bb4a6fb657cf7d00b93, user_id=52b5aad98fa04fd3bd46cfe26c0b47d5, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:23.261195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:23.316637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 731/1490] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:23 2022] PUT /identity/v3/projects/8fcc45b591314bb4a6fb657cf7d00b93/users/52b5aad98fa04fd3bd46cfe26c0b47d5/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:23.331494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:23.332017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:23.332376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:23.445234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] MFA Rules not processed for user `52b5aad98fa04fd3bd46cfe26c0b47d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:23.462062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:23.740989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:23.750141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 760/1491] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:23.943136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48394201-0199-4882-a00c-087bd03d5a30 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:23.963543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:23.964185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:23.964499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:23.964770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:23.965434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:23.967406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:24.053065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 732/1492] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:23 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:24.057814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:24.083137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00e9d-3f79-458a-8292-839185afbf7b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:24.164743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:24.168891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:24.277939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127246-d946-4292-9482-3184df153c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:24.278842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127246-d946-4292-9482-3184df153c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:24.281965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127246-d946-4292-9482-3184df153c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:24.282345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127246-d946-4292-9482-3184df153c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:24.283359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127246-d946-4292-9482-3184df153c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:24.286326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127246-d946-4292-9482-3184df153c16 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:24.351622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:24.372322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 761/1493] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:24 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:24.374576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127246-d946-4292-9482-3184df153c16 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:24.393418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ef34-0e4f-48ba-a314-8c4757e4d380 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:24.402783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:24.403707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:24.404217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:24.404700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:24.408897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:24.421130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127246-d946-4292-9482-3184df153c16 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:24.429117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:24.429763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:24.430046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:24.430321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:24.431468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:24.434572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:24.470876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 762/1494] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:24.472846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:24.536315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119806c-f976-48a3-8d12-4698e9949fdf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:24.536942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:24.567679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:24.570392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:24.578838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:24.579548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:24.582478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:24.583551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] PATH_INFO: `/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598/users/59f8ce0295ef415bb9d6837e14692a36/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:24.607665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 733/1495] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:24.623476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c189b0b69e6d4c27bf33ffd6158f5598, user_id=59f8ce0295ef415bb9d6837e14692a36, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:24.627543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:24.692066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 763/1496] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:24 2022] PUT /identity/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598/users/59f8ce0295ef415bb9d6837e14692a36/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:24.692417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:24.712476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fadf9-d746-441a-b42c-09515127923e service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:24.940993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:24.942090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:24.942222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:24.944066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:24.950216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:24.955796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bfab6-d883-46c4-94fb-4e252d1e0a51 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:25.001352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:25.003249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 734/1497] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:25.023761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437cb8a-e82f-409e-a881-f3176e9abf0e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:25.044915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:25.045606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:25.045887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:25.046167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] PATH_INFO: `/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598/users/59f8ce0295ef415bb9d6837e14692a36/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:25.057358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c189b0b69e6d4c27bf33ffd6158f5598, user_id=59f8ce0295ef415bb9d6837e14692a36, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:25.060073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:25.108066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 764/1498] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:25 2022] PUT /identity/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598/users/59f8ce0295ef415bb9d6837e14692a36/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:25.122414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:25.122855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:25.123898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:25.189979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] MFA Rules not processed for user `59f8ce0295ef415bb9d6837e14692a36`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:25.199177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:25.205417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:25.207458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:25.425747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532617-603f-4a52-88cc-66e51d144ea7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:25.437929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:25.439174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:25.441017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:25.441631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] PATH_INFO: `/v3/projects/3ba82581e3d34484a6de688227e6c2f7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:25.444090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba82581e3d34484a6de688227e6c2f7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:25.452056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:25.497083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 735/1499] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:25.507139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:25.509465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:25.653443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba82581e3d34484a6de688227e6c2f7', 'request_id': 'req-785bc2db-c691-47d2-9488-30e02f37662f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:25.676535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba82581e3d34484a6de688227e6c2f7', 'request_id': 'req-785bc2db-c691-47d2-9488-30e02f37662f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:25.689605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba82581e3d34484a6de688227e6c2f7', 'request_id': 'req-785bc2db-c691-47d2-9488-30e02f37662f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:25.699781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a2bf-28b7-43ad-afe1-4f8065058827 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:25.727292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] The token cache is being invalidate because project 3ba82581e3d34484a6de688227e6c2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:25.730133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:25.733141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-785bc2db-c691-47d2-9488-30e02f37662f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:25.749744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 765/1500] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:25 2022] DELETE /identity/v3/projects/3ba82581e3d34484a6de688227e6c2f7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:25.755924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a983-0ff0-4f85-b5e4-aa6c6c58bf56 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:25.756221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a983-0ff0-4f85-b5e4-aa6c6c58bf56 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:25.759909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a983-0ff0-4f85-b5e4-aa6c6c58bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:25.782203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:25.836003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:25.837903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:25.839656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:25.850139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:25.858683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:25.872978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3874a983-0ff0-4f85-b5e4-aa6c6c58bf56 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:25.878682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3874a983-0ff0-4f85-b5e4-aa6c6c58bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:26.045270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:26.121522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 766/1501] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:26.129113 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.136736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.136906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.137442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.137442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.173202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 736/1502] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:26.173850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:26.175188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:26.218467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 767/1503] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:26.219564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.259575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aaee6-7b89-49d2-93c5-f7d79b73d60f service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.291471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.292288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.293101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.293101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.293452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:26.293745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.303431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.365124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.376671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 737/1504] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:26.380320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5dad-aa0c-448a-898a-a92309c74e9f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.400066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.400785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.401674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.402914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.404754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:26.406662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.412328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.425359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.450230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b35ad-c4d5-4679-ab2b-73f0943b6ff0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.463250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.463882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.464168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.464575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.472296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:26.528498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 768/1505] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:26 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:26.536383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.701397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.701970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ff78f-25d0-42e6-847c-6701099b5bdd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.704226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.708960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.709671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.710035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.710366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.711816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.714402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04facceb-1276-4386-b8e8-87ffc4750fd6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.744795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 738/1506] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:26.753658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 769/1507] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:26 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:26.755082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.771859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff622-d514-465e-8644-2ff1c7708408 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.794009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69d9c-db1f-4bc7-bc99-b8cfce90957c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.795540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69d9c-db1f-4bc7-bc99-b8cfce90957c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.796290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69d9c-db1f-4bc7-bc99-b8cfce90957c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.801020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 770/1508] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:21:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:21:26.801668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.802293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.802632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.802996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.803720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.805848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c4645-8590-4111-9650-6b0913442e1e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:26.840861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 739/1509] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:26.846382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69d9c-db1f-4bc7-bc99-b8cfce90957c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:26.902102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504370-c410-40bc-b432-eb9188d6cb61 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.902394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504370-c410-40bc-b432-eb9188d6cb61 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.902819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504370-c410-40bc-b432-eb9188d6cb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.905492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69d9c-db1f-4bc7-bc99-b8cfce90957c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:26.948048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-86504370-c410-40bc-b432-eb9188d6cb61 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:26.949517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86504370-c410-40bc-b432-eb9188d6cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:26.973064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:26.974525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:26.976408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:26.977197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:26.978556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:26.989064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:27.048008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 771/1510] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:27.058959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:27.071331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:27.122202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651ee67-1f78-4ced-9f45-b29ec42537ea admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:27.125343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 740/1511] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:27.150046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:27.151308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:27.152213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:27.152898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] PATH_INFO: `/v3/projects/6ca4a81aa2c84aa19d279fe93b8cf7b6/users/74c55d0b4dbd4c5882d2c034e93866a8/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:27.187893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca4a81aa2c84aa19d279fe93b8cf7b6, user_id=74c55d0b4dbd4c5882d2c034e93866a8, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:27.190878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:27.242935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 772/1512] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:27 2022] PUT /identity/v3/projects/6ca4a81aa2c84aa19d279fe93b8cf7b6/users/74c55d0b4dbd4c5882d2c034e93866a8/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:27.261093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:27.262593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:27.265060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:27.370785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] MFA Rules not processed for user `74c55d0b4dbd4c5882d2c034e93866a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:27.374802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:27.391564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:27.402215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:27.598831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47e33-c81e-4822-9deb-0d3b436350b7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:27.604939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:27.605710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:27.606133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:27.606499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:27.614812 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:27.621304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:27.624203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:27.640933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 773/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:28.140490 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 741/1514] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 884 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:28.146053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:28.300592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0598-908c-41aa-8207-b48f8c8f5ab5 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:28.330843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:28.331481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:28.331764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:28.332042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:28.332758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:28.334699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:28.461377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:28.472238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 774/1515] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:28 2022] POST /identity/v3/projects => generated 401 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:28.478317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14078ee0-3e0e-49f4-af53-4b5580ddf171 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:28.746860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:28.756737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:28.757475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:28.758043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:28.762196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:28.764452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:28.849339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 742/1516] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:28 2022] POST /identity/v3/users => generated 307 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:28.853237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:28.873146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013769c-c75f-46ca-bd73-969759165456 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:28.886080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:28.889366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:28.889366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:28.891201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:28.894386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:28.899361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:28.930560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 775/1517] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:28.934785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:28.950161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda1785-09e0-48bc-977a-6e03e437be67 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:28.958690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:28.961133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:28.962341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:28.963260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] PATH_INFO: `/v3/projects/24d299e5407149c4ae9bd96553b00309/users/94885a302c974146bd120e701a2bfb71/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.007557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d299e5407149c4ae9bd96553b00309, user_id=94885a302c974146bd120e701a2bfb71, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:29.013233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:29.063250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 743/1518] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:28 2022] PUT /identity/v3/projects/24d299e5407149c4ae9bd96553b00309/users/94885a302c974146bd120e701a2bfb71/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:29.067975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:29.087002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9b6f0-bee8-4352-9f24-27cff2d85a5d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:29.238887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:29.240291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:29.240813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:29.241299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.242148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:29.258147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79aa9a-d00d-4632-8dec-eeb8aa164aea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:29.328801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 776/1519] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:29.333768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:29.365511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcbda-6eae-4a7e-bb97-9f0b6becb810 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:29.372890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:29.373978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:29.374571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:29.376006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] PATH_INFO: `/v3/projects/24d299e5407149c4ae9bd96553b00309/users/94885a302c974146bd120e701a2bfb71/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.382387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d299e5407149c4ae9bd96553b00309, user_id=94885a302c974146bd120e701a2bfb71, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:29.421401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:29.488527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 744/1520] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:29 2022] PUT /identity/v3/projects/24d299e5407149c4ae9bd96553b00309/users/94885a302c974146bd120e701a2bfb71/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:29.500243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:29.500775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:29.501221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.579344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:29.581686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:29.600433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] MFA Rules not processed for user `94885a302c974146bd120e701a2bfb71`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:29.602161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:29.631555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:29.750631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c9e1c-9139-4089-8da6-130b177beaae admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:29.760576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:29.761684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:29.762134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:29.762589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] PATH_INFO: `/v3/users/947eb82557414f2ba0a4187a8ca87a70` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.764690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947eb82557414f2ba0a4187a8ca87a70)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:29.774098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:29.782172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:29.866632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 777/1521] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:29 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:29.877467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:29.882418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:29.888345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947eb82557414f2ba0a4187a8ca87a70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:29.901623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947eb82557414f2ba0a4187a8ca87a70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:29.917832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947eb82557414f2ba0a4187a8ca87a70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:29.918608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947eb82557414f2ba0a4187a8ca87a70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:29.930169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3ee932-7ed6-4d45-91e0-a71008cc2d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947eb82557414f2ba0a4187a8ca87a70'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:29.943521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 745/1522] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:29 2022] DELETE /identity/v3/users/947eb82557414f2ba0a4187a8ca87a70 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:29.955327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cefcb-9c2f-4fd5-8a32-51a36c6627d5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:29.955719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cefcb-9c2f-4fd5-8a32-51a36c6627d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:29.956970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cefcb-9c2f-4fd5-8a32-51a36c6627d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:29.981347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-526cefcb-9c2f-4fd5-8a32-51a36c6627d5 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:30.003175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-526cefcb-9c2f-4fd5-8a32-51a36c6627d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.026467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2dff-ad47-4fc2-8746-7872ca6485c1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:30.248312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:30.249039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:30.249238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:30.249513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:30.284997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.296005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 746/1523] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:30.321415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:30.321733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:30.321969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:30.323823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 747/1524] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 19:21:30.348235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:30.353196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.467440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:30.471016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40706efe-c68e-4206-98dd-8ef34a9529cc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:30.517900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 778/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:30.523093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:30.523527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:30.524007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:30.525399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:30.538744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8d0b-aa3b-43ec-9e60-818476ba753e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:30.555287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:30.556914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:30.557351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:30.559325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:30.582814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:30.587663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:30.590176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:30.600054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.626177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 748/1526] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:30.756185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:30.757844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.791667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a1a65-54f0-4ec7-b6ec-073189c51b8f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:30.798922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:30.808206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:30.809675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:30.810044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:30.810321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:30.817020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:30.859406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 779/1527] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:30.976913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:30.978647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5f471-a687-43de-9af1-f9e1a4f13bfc service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:30.991972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 749/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:31.000070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:31.001856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:31.024290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cc4db-c51b-4cba-bf07-de96017d9f24 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:31.029765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:31.030577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:31.030855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:31.031294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] PATH_INFO: `/v3/users/52b5aad98fa04fd3bd46cfe26c0b47d5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:31.032741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b5aad98fa04fd3bd46cfe26c0b47d5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:31.035879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:31.155226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b5aad98fa04fd3bd46cfe26c0b47d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:31.180317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b5aad98fa04fd3bd46cfe26c0b47d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:31.212146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b5aad98fa04fd3bd46cfe26c0b47d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:31.225904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b5aad98fa04fd3bd46cfe26c0b47d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:31.226768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b5aad98fa04fd3bd46cfe26c0b47d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:31.246135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 780/1529] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:30 2022] DELETE /identity/v3/users/52b5aad98fa04fd3bd46cfe26c0b47d5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:31.259596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:31.260594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:31.261594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:31.373640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:31.374882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:31.416371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:31.418038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:31.528733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 750/1530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:31.565319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:31.567277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:31.743491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16276025-9e93-4453-b650-7d64ca16a623 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:31.751770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086bf2-1348-4b53-96e6-efd7cd5b5874 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:31.762750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:31.763996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:31.764959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:31.765345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:31.765651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:31.766143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:31.766388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:31.766693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:31.797157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:31.821630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:31.826902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:31.835398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:31.843834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:31.858314 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 751/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:31.882519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 781/1532] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:32.464975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:32.466257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:32.486091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11eb04-012d-407c-93ba-5bca63a4f548 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:32.499063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:32.499820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:32.500005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:32.500752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] PATH_INFO: `/v3/projects/816fcc5c31ae4e15ac7097eab418e55b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:32.503538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816fcc5c31ae4e15ac7097eab418e55b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:32.505799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:32.551083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:32.576722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816fcc5c31ae4e15ac7097eab418e55b', 'request_id': 'req-24752b02-ddae-44cf-8384-47f8e356a3b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.587860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816fcc5c31ae4e15ac7097eab418e55b', 'request_id': 'req-24752b02-ddae-44cf-8384-47f8e356a3b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.595181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816fcc5c31ae4e15ac7097eab418e55b', 'request_id': 'req-24752b02-ddae-44cf-8384-47f8e356a3b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.609057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] The token cache is being invalidate because project 816fcc5c31ae4e15ac7097eab418e55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:32.609351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.610055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.612562 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 752/1533] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:32 2022] DELETE /identity/v3/projects/816fcc5c31ae4e15ac7097eab418e55b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:32.616380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:32.627391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99079-6c4b-4aed-b72b-3193067a4e71 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:32.673726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:32.688990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:32.688990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:32.705112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:32.706161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:32.706760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:32.707255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] PATH_INFO: `/v3/users/664e451bc01d40529184868867501d56` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:32.709426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664e451bc01d40529184868867501d56)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:32.712281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:32.768656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664e451bc01d40529184868867501d56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.783505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752b02-ddae-44cf-8384-47f8e356a3b2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:32.788834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:32.789474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:32.790479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:32.790948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] PATH_INFO: `/v3/projects/8fcc45b591314bb4a6fb657cf7d00b93` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:32.792258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcc45b591314bb4a6fb657cf7d00b93)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:32.794372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:32.795619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664e451bc01d40529184868867501d56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.804802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664e451bc01d40529184868867501d56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.812868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664e451bc01d40529184868867501d56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.813724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664e451bc01d40529184868867501d56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.820603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 782/1534] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:32 2022] DELETE /identity/v3/users/664e451bc01d40529184868867501d56 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:32.850258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcc45b591314bb4a6fb657cf7d00b93', 'request_id': 'req-fd21c196-3e0c-4820-ba8d-028db5a4673f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.851223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:32.852721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:32.861094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcc45b591314bb4a6fb657cf7d00b93', 'request_id': 'req-fd21c196-3e0c-4820-ba8d-028db5a4673f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.867776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcc45b591314bb4a6fb657cf7d00b93', 'request_id': 'req-fd21c196-3e0c-4820-ba8d-028db5a4673f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.881661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] The token cache is being invalidate because project 8fcc45b591314bb4a6fb657cf7d00b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:32.881965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.884102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:32.886813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 753/1535] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:32 2022] DELETE /identity/v3/projects/8fcc45b591314bb4a6fb657cf7d00b93 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:32.891020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:32.892731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:32.933359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e282ca7-0b64-4f85-b69b-a12be5b1f1d0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:32.956410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:32.990826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c196-3e0c-4820-ba8d-028db5a4673f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:33.003339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:33.004045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.004277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.004594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] PATH_INFO: `/v3/users/59f8ce0295ef415bb9d6837e14692a36` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.006664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f8ce0295ef415bb9d6837e14692a36)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:33.010674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:33.017102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:33.017744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.018082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.018489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] PATH_INFO: `/v3/users/f66ef9102cb045b78c560596918d29dd` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.020417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66ef9102cb045b78c560596918d29dd)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:33.023012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:33.046944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:33.104957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f8ce0295ef415bb9d6837e14692a36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.109448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66ef9102cb045b78c560596918d29dd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.115087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f8ce0295ef415bb9d6837e14692a36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.134296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66ef9102cb045b78c560596918d29dd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.135107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f8ce0295ef415bb9d6837e14692a36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.137463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f8ce0295ef415bb9d6837e14692a36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.148995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66ef9102cb045b78c560596918d29dd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.152027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f8ce0295ef415bb9d6837e14692a36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.165955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 754/1536] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:32 2022] DELETE /identity/v3/users/59f8ce0295ef415bb9d6837e14692a36 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:33.165955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:33.169300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:33.176221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66ef9102cb045b78c560596918d29dd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.177327 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d51c4317-ba3f-4f58-a993-18ce1b2c3560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66ef9102cb045b78c560596918d29dd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.202863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 783/1537] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:32 2022] DELETE /identity/v3/users/f66ef9102cb045b78c560596918d29dd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:33.209799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.210520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.211095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.246368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:33.248848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:33.271744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892aa668-e46f-4b4a-9d90-0ba4adbc7c52 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:33.358062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:33.358831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.359112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.359445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] PATH_INFO: `/v3/projects/ab06d8f24e0c4a1aa5c7935665cbc227` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.360891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab06d8f24e0c4a1aa5c7935665cbc227)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:33.362915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:33.378852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:33.395742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 784/1538] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:33.408178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:33.410185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:33.436226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab06d8f24e0c4a1aa5c7935665cbc227', 'request_id': 'req-e4407902-c284-42b2-8c1b-175aefda8ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.470900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab06d8f24e0c4a1aa5c7935665cbc227', 'request_id': 'req-e4407902-c284-42b2-8c1b-175aefda8ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.503516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab06d8f24e0c4a1aa5c7935665cbc227', 'request_id': 'req-e4407902-c284-42b2-8c1b-175aefda8ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.520841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] The token cache is being invalidate because project ab06d8f24e0c4a1aa5c7935665cbc227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:33.521148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.523090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.533776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 755/1539] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:33 2022] DELETE /identity/v3/projects/ab06d8f24e0c4a1aa5c7935665cbc227 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:33.538895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:33.541104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:33.551018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fcda3-af33-41d1-9f1f-d318fafe5b55 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:33.640949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:33.650500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:33.651930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.652234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.652567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.657326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:33.686410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407902-c284-42b2-8c1b-175aefda8ccd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:33.693574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:33.694415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:33.694695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:33.695728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] PATH_INFO: `/v3/users/3a4b479e21f3467f93272b78376ddb04` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:33.697901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4b479e21f3467f93272b78376ddb04)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:33.700918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:33.800392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4b479e21f3467f93272b78376ddb04'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.808447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4b479e21f3467f93272b78376ddb04'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.827826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4b479e21f3467f93272b78376ddb04'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.832886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4b479e21f3467f93272b78376ddb04'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.839788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:33.841612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec34cc-4b5c-4b72-9ee7-a000b5674a63 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:33.842947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4b479e21f3467f93272b78376ddb04'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:33.851193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 756/1540] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:33 2022] DELETE /identity/v3/users/3a4b479e21f3467f93272b78376ddb04 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:33.853892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 785/1541] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:34.339815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:34.341438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:34.369121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:34.459214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91ae3-fcb3-40d3-b294-c9327010f3af admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:34.465695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:34.466242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:34.466642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:34.467110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] PATH_INFO: `/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:34.468423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c189b0b69e6d4c27bf33ffd6158f5598)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:34.470627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:34.568698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c189b0b69e6d4c27bf33ffd6158f5598', 'request_id': 'req-9139ff55-da66-4fd6-af32-c3bca7218116'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:34.579798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c189b0b69e6d4c27bf33ffd6158f5598', 'request_id': 'req-9139ff55-da66-4fd6-af32-c3bca7218116'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:34.589666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c189b0b69e6d4c27bf33ffd6158f5598', 'request_id': 'req-9139ff55-da66-4fd6-af32-c3bca7218116'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:34.608492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] The token cache is being invalidate because project c189b0b69e6d4c27bf33ffd6158f5598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:34.609677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:34.610529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9139ff55-da66-4fd6-af32-c3bca7218116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:34.617445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 757/1542] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:34 2022] DELETE /identity/v3/projects/c189b0b69e6d4c27bf33ffd6158f5598 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:34.619301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:34.619823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:34.620534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:34.666137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:34.667400 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:34.800900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 786/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:34.802790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:34.803241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:34.803335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:34.848313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:34.856508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:34.875482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 758/1544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:34.876249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:34.892740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d485a-e672-4123-81b3-daeadd625a04 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:34.918479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:34.919115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:34.919396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:34.919666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:34.920323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:34.920653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:34.922985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:34.944514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:34.948760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 787/1545] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:21:34.964994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649091-d860-4883-8d0a-f2b3751c2d5c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:34.966358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:34.968727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:34.973239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:34.973919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:34.974392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:34.975515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:34.975515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:34.977867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.000096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9228-b3f0-4492-9545-c07db31ea7b2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.007996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418139-2690-443d-9081-b2a798840256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.008567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418139-2690-443d-9081-b2a798840256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.009202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418139-2690-443d-9081-b2a798840256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.009202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418139-2690-443d-9081-b2a798840256 admin admin] PATH_INFO: `/v3/projects/c4cc22bc0db140068e5e9582e665050e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.010903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418139-2690-443d-9081-b2a798840256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cc22bc0db140068e5e9582e665050e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.013955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418139-2690-443d-9081-b2a798840256 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.032515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 759/1546] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:34 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.032515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.036171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.090629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cc22bc0db140068e5e9582e665050e', 'request_id': 'req-96418139-2690-443d-9081-b2a798840256'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.100176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cc22bc0db140068e5e9582e665050e', 'request_id': 'req-96418139-2690-443d-9081-b2a798840256'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.120632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cc22bc0db140068e5e9582e665050e', 'request_id': 'req-96418139-2690-443d-9081-b2a798840256'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.120816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] The token cache is being invalidate because project c4cc22bc0db140068e5e9582e665050e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:35.121106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.121760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.122159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072a6b-6a30-430d-99d7-792f10704961 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.123324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 788/1547] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:34 2022] DELETE /identity/v3/projects/c4cc22bc0db140068e5e9582e665050e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:35.124059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.125656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.136210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.150504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.185377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.186095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.186382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.186661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] PATH_INFO: `/v3/projects/146ed97d51b048a0af67ac7886117a00` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.187816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=146ed97d51b048a0af67ac7886117a00)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.189775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.195638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418139-2690-443d-9081-b2a798840256 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.200377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.201009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.201290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.201559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.202187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.204182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857b6f7-6c66-42d5-a448-4821256d3ecb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.227824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 789/1548] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.229498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4fbf3-f270-4957-bf81-f4612424cd76 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.229784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4fbf3-f270-4957-bf81-f4612424cd76 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.230060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4fbf3-f270-4957-bf81-f4612424cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.240788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146ed97d51b048a0af67ac7886117a00', 'request_id': 'req-3e514101-4f1f-464e-afa4-668a4e1c9b39'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.248147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146ed97d51b048a0af67ac7886117a00', 'request_id': 'req-3e514101-4f1f-464e-afa4-668a4e1c9b39'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.249714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-26f4fbf3-f270-4957-bf81-f4612424cd76 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:35.250920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-26f4fbf3-f270-4957-bf81-f4612424cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.254553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146ed97d51b048a0af67ac7886117a00', 'request_id': 'req-3e514101-4f1f-464e-afa4-668a4e1c9b39'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.265733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] The token cache is being invalidate because project 146ed97d51b048a0af67ac7886117a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:35.266033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.266688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:35.268299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 760/1549] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:35 2022] DELETE /identity/v3/projects/146ed97d51b048a0af67ac7886117a00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:35.269412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.270705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.322652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 790/1550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:35.324093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328329-38e5-4311-8b60-b29da503ef25 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.324384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328329-38e5-4311-8b60-b29da503ef25 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.324690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328329-38e5-4311-8b60-b29da503ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.344430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514101-4f1f-464e-afa4-668a4e1c9b39 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.345412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2f328329-38e5-4311-8b60-b29da503ef25 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:35.346832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2f328329-38e5-4311-8b60-b29da503ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.350940 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.351551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.351829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.352102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.352809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.354439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddff98-8ab6-484f-8c00-ca30b2e8685f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.355441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 791/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:35.356687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.357046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.357245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.369953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 761/1552] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:35.371290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.371576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.371845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.379895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:35.381130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.389651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 792/1553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:35.392780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:35.393590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.394516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.403718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2122-2643-418f-85db-beddee9f95d9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.404722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 762/1554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:35.405982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.413985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.414950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.415568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.416025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.416790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.417452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03250-9523-4011-8c9c-aab8bbcac27d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.418519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.422893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.423497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.423830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.424110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.425382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:35.425702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.427371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.441024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 793/1555] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:35.441024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.441316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 763/1556] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:35.443785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.454589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a976-cd87-4dd3-9ce8-5f62cd1a883f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.457153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547865e-991f-4949-93c4-d561de198011 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.460138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.460778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.461057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.461805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.461983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:35.462289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.462396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.463140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.463488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.463830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] PATH_INFO: `/v3/projects/c2d90dd0e1a5403daabb918fa57dc339/users/00046ab45a644e5695060fdc2619ff71/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.463921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.478109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 794/1557] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:35.478538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.483037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d90dd0e1a5403daabb918fa57dc339, user_id=00046ab45a644e5695060fdc2619ff71, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.487581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.488966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98471508-e15f-40eb-86da-29ae63e7982b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.493674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.494343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.494671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.495011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.495594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.497694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c7ee5-1b80-4ef7-8cf0-822268f636ee admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.514724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 764/1558] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:35 2022] PUT /identity/v3/projects/c2d90dd0e1a5403daabb918fa57dc339/users/00046ab45a644e5695060fdc2619ff71/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:35.517364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.525603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 795/1559] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.528001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.528290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.528608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.539332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.558192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] MFA Rules not processed for user `00046ab45a644e5695060fdc2619ff71`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:35.559405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:35.586685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.594600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be665-868a-4cbc-9271-f888c6d4361c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.627236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 796/1560] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:35.628098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.655717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.656332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.656649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.656927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.657581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.660043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.692210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 765/1561] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.692210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.693039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccd7b-ab39-4395-894e-84716d12e114 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.750267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.750895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.751169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.751438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.752072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.754335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.754586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388d0c4-b55d-4ace-9e69-662486b92ffa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.760042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.760676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.760960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.761231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.761862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.764022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.785832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 797/1562] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.785832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.800298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae6e3-76cb-449d-99ef-e31b1b41713b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.803753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 766/1563] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.803753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.838714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.874338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.875157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.875719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.876136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.876266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f74e4-3805-42f1-a33a-261fa01c053d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.877068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.879872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.881910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.882560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.882813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.883086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.883739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.885639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.892809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:35.897005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 767/1564] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:35.897949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.909171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d1e7d-c519-4451-a278-7c328b28af07 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.914154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.914766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.915051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.915581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.916508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 798/1565] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.917704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.919607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.921619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.931913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900228a4-dd06-4817-b310-95213c76729b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.939772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.941483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.941801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.942141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.943075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.945983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.959164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 768/1566] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:35 2022] POST /identity/v3/users => generated 300 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:35.959164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.970454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 799/1567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:35.971601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:35.974879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b411f48-8b78-4665-bea3-33794120e24a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.980132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.980949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.981374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.981801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.982448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.983422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73be0fc-9af4-48c7-9cf2-cf4df0011a62 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:35.984055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.989288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:35.989669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:35.990067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:35.990457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:35.991200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:35.992941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:35.997324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 769/1568] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:35.998609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.008197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 800/1569] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:36.008197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.012045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13c307-ead5-4149-91a6-9ae5fb4df20c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.017782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.018165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437bac-4af4-489e-8861-468a5e152563 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.019106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.019386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.019832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] PATH_INFO: `/v3/projects/a637a869f9ce44dca576ce4fd3153ee8/users/d1f15f28bba84ac89fd9902dfe168468/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.023712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.024405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.024805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.025169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.025892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.027569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.041804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a637a869f9ce44dca576ce4fd3153ee8, user_id=d1f15f28bba84ac89fd9902dfe168468, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.047731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 801/1570] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:36.047881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.047960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.060689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 770/1571] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:35 2022] PUT /identity/v3/projects/a637a869f9ce44dca576ce4fd3153ee8/users/d1f15f28bba84ac89fd9902dfe168468/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:36.062270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.067107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1dce4-759a-4ee9-b93d-b2fd0dc4ad0e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.148826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.148826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.148826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.148826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] PATH_INFO: `/v3/projects/cfeccc46f1f94748bac4661fce020a3d/users/987fb71d04bd46aaac72439096a08ef9/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.149098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6315f-8545-4435-9d62-feb93ece0ac1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.157124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.157124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.157124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.157124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] PATH_INFO: `/v3/projects/7073b196f80b413eb10e1789ba4813c4/users/e80b7e30ef1540cb91c71834d6e7e5c4/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.164024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeccc46f1f94748bac4661fce020a3d, user_id=987fb71d04bd46aaac72439096a08ef9, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.167603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f95454-ffe7-49b6-9c0b-c25e84a3fed7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.175291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7073b196f80b413eb10e1789ba4813c4, user_id=e80b7e30ef1540cb91c71834d6e7e5c4, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.178124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.182373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 802/1572] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:36 2022] PUT /identity/v3/projects/cfeccc46f1f94748bac4661fce020a3d/users/987fb71d04bd46aaac72439096a08ef9/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:36.186229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.186522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.186782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.194632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 771/1573] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:36 2022] PUT /identity/v3/projects/7073b196f80b413eb10e1789ba4813c4/users/e80b7e30ef1540cb91c71834d6e7e5c4/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:36.195325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.206065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.207824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:36.209038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.273476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:36.278296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 803/1574] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:36.279090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.281795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e415622-d99e-47c4-99d1-33e659422e48 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.289972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.290631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e9bf8-44fb-460f-8bc8-6fa0b986f4f4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.290889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.291175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.291547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] PATH_INFO: `/v3/users/74c55d0b4dbd4c5882d2c034e93866a8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.292808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c55d0b4dbd4c5882d2c034e93866a8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.295586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.296723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.297395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.297737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.298218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.298940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.300814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94727-8031-4e33-a72e-f0617675180b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.311710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 804/1575] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:36.320559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.320559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.320559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.342723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] MFA Rules not processed for user `e80b7e30ef1540cb91c71834d6e7e5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:36.343926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.344035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c55d0b4dbd4c5882d2c034e93866a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:36.351619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c55d0b4dbd4c5882d2c034e93866a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:36.364507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c55d0b4dbd4c5882d2c034e93866a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:36.365247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c55d0b4dbd4c5882d2c034e93866a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:36.365838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:36.373432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c55d0b4dbd4c5882d2c034e93866a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:36.381612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 772/1576] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:36 2022] DELETE /identity/v3/users/74c55d0b4dbd4c5882d2c034e93866a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:36.382802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.384158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.413182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 805/1577] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:36.417250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.417250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.428249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e396c-0b08-40ae-8ebf-3eb91cde6329 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.447859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fdc57-658e-4ea4-ac99-2c54cdf7cb62 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.452285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.452935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.453218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.453494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.455240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.489795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.490471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.490752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.491032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] PATH_INFO: `/v3/projects/cfeccc46f1f94748bac4661fce020a3d/users/987fb71d04bd46aaac72439096a08ef9/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.493020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeccc46f1f94748bac4661fce020a3d, user_id=987fb71d04bd46aaac72439096a08ef9, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.495692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b20b42-f767-44a9-b5e9-cf5216db784c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.518404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 806/1578] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:36 2022] PUT /identity/v3/projects/cfeccc46f1f94748bac4661fce020a3d/users/987fb71d04bd46aaac72439096a08ef9/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:36.518404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4499-a311-4914-85c0-07c2b0a9480f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.518404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4499-a311-4914-85c0-07c2b0a9480f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.518404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4499-a311-4914-85c0-07c2b0a9480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.534755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.536482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8eeb4499-a311-4914-85c0-07c2b0a9480f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:36.536996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.537772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8eeb4499-a311-4914-85c0-07c2b0a9480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.548687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 773/1579] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:36.549918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.551479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.563548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11257-dcf0-43a2-853f-ad7a93d023d4 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.584975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:36.621749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 807/1580] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:36.625901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.626318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.626610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.643635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.645082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.645367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.645641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.646284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.648238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.657290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] MFA Rules not processed for user `987fb71d04bd46aaac72439096a08ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:36.658629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.680215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 774/1581] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:36.681415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.683223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.712258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:36.744291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 808/1582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:36.745237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.757528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856bd5-b136-49fe-9da0-7c57ec627709 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.768312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaffe5c-4849-4690-acc6-a7722c896883 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.772308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.777501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.777501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.777709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.857857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.859185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.861182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.861625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.864180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.868937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.871547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.886589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.904666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 809/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:36 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:36.906035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 775/1584] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:36.906927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.908501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.908760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:36.922720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f4b77-d612-4402-89d3-91464c5015ee admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.931109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.931997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.932527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.933011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:36.933841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:36.935622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:36.952228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 810/1585] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:36.957002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:36.975915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fd5c-cc75-4a5f-b378-e7e3f042fdac admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:36.983623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:36.984868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:36.985231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:36.985585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] PATH_INFO: `/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1/users/4172330922db42d39a16d2b883cc923e/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.002169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875594ad-57ed-4df8-a1b1-f51bafdef8ab service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.008134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb70a6b6555423dae9fd93b3fd9f7b1, user_id=4172330922db42d39a16d2b883cc923e, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.009830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.010460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.010790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.011061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.011880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.030226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:37.038887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 811/1586] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:36 2022] PUT /identity/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1/users/4172330922db42d39a16d2b883cc923e/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:37.043765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:37.128901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.133013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.153198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 776/1587] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:37.171668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fd9a-1a4a-4f0b-b4ed-08c864d44b95 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.188949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.189582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.189896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.190206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.191143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.192803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3dea3-09b3-4474-9d29-3b6711c39751 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.206861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 812/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:37.211373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:37.225021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4dc72-57eb-4ded-b43e-97b2d029c23f service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.233336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.234597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.235572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.236007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] PATH_INFO: `/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1/users/4172330922db42d39a16d2b883cc923e/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.238628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb70a6b6555423dae9fd93b3fd9f7b1, user_id=4172330922db42d39a16d2b883cc923e, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.243881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.295538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 777/1589] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:37 2022] PUT /identity/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1/users/4172330922db42d39a16d2b883cc923e/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:37.306865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.307159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.307442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.375124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] MFA Rules not processed for user `4172330922db42d39a16d2b883cc923e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:37.376489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:37.386337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:37.440602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:37.497393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c449df0-2ead-4386-baf1-61ca8c305fd1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.504448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.505125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.505463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.505752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] PATH_INFO: `/v3/users/00046ab45a644e5695060fdc2619ff71` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.514092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00046ab45a644e5695060fdc2619ff71)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.517215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.531521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 813/1590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:37.545641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:37.618149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00046ab45a644e5695060fdc2619ff71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:37.644985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00046ab45a644e5695060fdc2619ff71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:37.660728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b87b-a77b-432b-bfcd-818179af9ee7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.665567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.666594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.666886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.667324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.681405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00046ab45a644e5695060fdc2619ff71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:37.681827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.682219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00046ab45a644e5695060fdc2619ff71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:37.683287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f2f99-d8b0-4523-8954-3789364d28f6 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.691453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00046ab45a644e5695060fdc2619ff71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:37.701400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 778/1591] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:37 2022] DELETE /identity/v3/users/00046ab45a644e5695060fdc2619ff71 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:37.704326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:37.707257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 814/1592] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:37.708423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572fcae-0b3b-4a60-8fe3-4f4dd7f47b36 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.708742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572fcae-0b3b-4a60-8fe3-4f4dd7f47b36 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.709046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572fcae-0b3b-4a60-8fe3-4f4dd7f47b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.726134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:37.732238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d572fcae-0b3b-4a60-8fe3-4f4dd7f47b36 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:37.734251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d572fcae-0b3b-4a60-8fe3-4f4dd7f47b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:37.760018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:37.847973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87437b9-e02e-468b-884e-e12123bfd64c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:37.854822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:37.855932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.857044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.857556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] PATH_INFO: `/v3/projects/6ca4a81aa2c84aa19d279fe93b8cf7b6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.858964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca4a81aa2c84aa19d279fe93b8cf7b6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:37.868900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:37.892760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 815/1593] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:37.894520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:37.895012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:37.896075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:37.929487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] MFA Rules not processed for user `d1f15f28bba84ac89fd9902dfe168468`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:37.935445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:37.990278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca4a81aa2c84aa19d279fe93b8cf7b6', 'request_id': 'req-3796196e-3dc0-44aa-94fa-792e6f431f86'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.004712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca4a81aa2c84aa19d279fe93b8cf7b6', 'request_id': 'req-3796196e-3dc0-44aa-94fa-792e6f431f86'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.017044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca4a81aa2c84aa19d279fe93b8cf7b6', 'request_id': 'req-3796196e-3dc0-44aa-94fa-792e6f431f86'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.038169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] The token cache is being invalidate because project 6ca4a81aa2c84aa19d279fe93b8cf7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:38.039371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.039853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:38.039967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.043390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 779/1594] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:37 2022] DELETE /identity/v3/projects/6ca4a81aa2c84aa19d279fe93b8cf7b6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:38.046308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.047445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.097802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 816/1595] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:38.097802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.108418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.124705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24073-11dc-4861-bd13-ab67729debba None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.137671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796196e-3dc0-44aa-94fa-792e6f431f86 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.142077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.143415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.143682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.144027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.146198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.200239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.201375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.201559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.201826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] PATH_INFO: `/v3/users/94885a302c974146bd120e701a2bfb71` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.202952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94885a302c974146bd120e701a2bfb71)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.205143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.220519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:38.223415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.226052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.240283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 780/1596] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:38.241226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.242882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.260203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94885a302c974146bd120e701a2bfb71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.274464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94885a302c974146bd120e701a2bfb71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.284355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94885a302c974146bd120e701a2bfb71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.298890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94885a302c974146bd120e701a2bfb71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.300023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94885a302c974146bd120e701a2bfb71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.309003 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 817/1597] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:38 2022] DELETE /identity/v3/users/94885a302c974146bd120e701a2bfb71 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:38.318050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.319699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.330000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b3ab-7622-431a-b618-59603690e9c9 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.405148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.405922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607a394-1426-44f2-b60b-c8599623158a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.406067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.406341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.406680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.409079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.411761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.412762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.413188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.413649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] PATH_INFO: `/v3/users/e80b7e30ef1540cb91c71834d6e7e5c4` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.415789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80b7e30ef1540cb91c71834d6e7e5c4)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.418104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.434528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:38.479888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80b7e30ef1540cb91c71834d6e7e5c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.495625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.497153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1455c-f0b4-483d-9580-a1d048bc1c12 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.501852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80b7e30ef1540cb91c71834d6e7e5c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.507462 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 781/1598] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:38.510231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80b7e30ef1540cb91c71834d6e7e5c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.519038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80b7e30ef1540cb91c71834d6e7e5c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.519776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80b7e30ef1540cb91c71834d6e7e5c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:38.526540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 818/1599] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:38 2022] DELETE /identity/v3/users/e80b7e30ef1540cb91c71834d6e7e5c4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:38.531560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.532117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.532503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.562190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:38.563397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.630901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 782/1600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:38.641981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.644303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.746841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815b728-72d4-4e1a-acb8-273942763d37 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.751373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.751999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.753189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.753436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.765766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.768615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.791126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 819/1601] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:38.913054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:38.915534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:38.933406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e78641-fb8c-42ca-ae18-62729a6586ff None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:38.951111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:38.952252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:38.952252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:38.952637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] PATH_INFO: `/v3/projects/c2d90dd0e1a5403daabb918fa57dc339` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:38.955889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d90dd0e1a5403daabb918fa57dc339)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:38.957833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:38.959807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:39.074427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d90dd0e1a5403daabb918fa57dc339', 'request_id': 'req-1a259ec9-2690-4887-9c3f-6b12a6b5a229'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.088988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d90dd0e1a5403daabb918fa57dc339', 'request_id': 'req-1a259ec9-2690-4887-9c3f-6b12a6b5a229'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.096919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d90dd0e1a5403daabb918fa57dc339', 'request_id': 'req-1a259ec9-2690-4887-9c3f-6b12a6b5a229'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.101860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.103343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.140787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] The token cache is being invalidate because project c2d90dd0e1a5403daabb918fa57dc339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:39.141106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.142322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.144422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675baef-4737-46e4-87a6-595bf4156b23 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.148499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 783/1602] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:38 2022] DELETE /identity/v3/projects/c2d90dd0e1a5403daabb918fa57dc339 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:39.149770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.151556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.225113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.225758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.226041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.226337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] PATH_INFO: `/v3/projects/24d299e5407149c4ae9bd96553b00309` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.227464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d299e5407149c4ae9bd96553b00309)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.229559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.239133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259ec9-2690-4887-9c3f-6b12a6b5a229 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.245083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.245801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.246082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.246760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] PATH_INFO: `/v3/users/987fb71d04bd46aaac72439096a08ef9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.247756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987fb71d04bd46aaac72439096a08ef9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.251123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.274225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:39.289065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d299e5407149c4ae9bd96553b00309', 'request_id': 'req-61469cd1-3f59-4ad8-82a5-8074a7793dee'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.299521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d299e5407149c4ae9bd96553b00309', 'request_id': 'req-61469cd1-3f59-4ad8-82a5-8074a7793dee'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.306975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d299e5407149c4ae9bd96553b00309', 'request_id': 'req-61469cd1-3f59-4ad8-82a5-8074a7793dee'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.308813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987fb71d04bd46aaac72439096a08ef9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.317823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987fb71d04bd46aaac72439096a08ef9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.320969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] The token cache is being invalidate because project 24d299e5407149c4ae9bd96553b00309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:39.321270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.321995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61469cd1-3f59-4ad8-82a5-8074a7793dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.323878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 820/1603] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:39 2022] DELETE /identity/v3/projects/24d299e5407149c4ae9bd96553b00309 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:39.328243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663ccf-c28f-4d9d-a5cb-7f89e657e218 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.329410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663ccf-c28f-4d9d-a5cb-7f89e657e218 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.329784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663ccf-c28f-4d9d-a5cb-7f89e657e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.353184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987fb71d04bd46aaac72439096a08ef9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.353965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987fb71d04bd46aaac72439096a08ef9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.360108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cc663ccf-c28f-4d9d-a5cb-7f89e657e218 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:39.361511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cc663ccf-c28f-4d9d-a5cb-7f89e657e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.365968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987fb71d04bd46aaac72439096a08ef9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.375261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 784/1604] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:39 2022] DELETE /identity/v3/users/987fb71d04bd46aaac72439096a08ef9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:39.376207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.378563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.391011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:39.460077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 821/1605] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:39.463184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a615b-346f-4902-916a-31c9545b91f7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.468160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.469083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.470075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.470862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] PATH_INFO: `/v3/projects/7073b196f80b413eb10e1789ba4813c4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.472179 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7073b196f80b413eb10e1789ba4813c4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.475167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.477070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.479535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.479946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.505234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:39.506531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.514799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 822/1606] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:39.520174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.529547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efd1e-09a2-462a-8f35-7f2443565da2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.538732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7073b196f80b413eb10e1789ba4813c4', 'request_id': 'req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.549793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7073b196f80b413eb10e1789ba4813c4', 'request_id': 'req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.573713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7073b196f80b413eb10e1789ba4813c4', 'request_id': 'req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.589857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] The token cache is being invalidate because project 7073b196f80b413eb10e1789ba4813c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:39.590171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.590817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.592685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 785/1607] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:39 2022] DELETE /identity/v3/projects/7073b196f80b413eb10e1789ba4813c4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:39.596696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.598087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.600659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.601527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.601953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.602370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.603496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:39.603945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.605720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.612374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5065-f130-4d4b-b1fb-6e6a61fe8db9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.617510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.618168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.618425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.618601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 823/1608] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:39.618708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] PATH_INFO: `/v3/users/4172330922db42d39a16d2b883cc923e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.619828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4172330922db42d39a16d2b883cc923e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.621804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.623235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.625059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.639716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a57621-c195-42df-989a-535c581fddb0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.645588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.646256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.646716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.647043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.647737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.649749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.683313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 824/1609] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:39.687476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.687851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4172330922db42d39a16d2b883cc923e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.703156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4172330922db42d39a16d2b883cc923e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.718587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4172330922db42d39a16d2b883cc923e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.719295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4172330922db42d39a16d2b883cc923e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.727207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4172330922db42d39a16d2b883cc923e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.739168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 786/1610] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:39 2022] DELETE /identity/v3/users/4172330922db42d39a16d2b883cc923e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:39.742209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.742209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.754432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:39.756607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:39.838373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011abf95-f98e-48ee-8455-08d63f56e153 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.856983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db648611-b3d3-4983-b78d-67801d6eaa3d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:39.862564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.863211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.863636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.863919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] PATH_INFO: `/v3/projects/cfeccc46f1f94748bac4661fce020a3d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.867518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeccc46f1f94748bac4661fce020a3d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.869553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.923541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:39.924375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.924813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.925203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.926502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:39.928982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:39.940814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeccc46f1f94748bac4661fce020a3d', 'request_id': 'req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.951423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeccc46f1f94748bac4661fce020a3d', 'request_id': 'req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.959768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeccc46f1f94748bac4661fce020a3d', 'request_id': 'req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.960141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 825/1611] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:39 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:39.961401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:39.965309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:39.974545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] The token cache is being invalidate because project cfeccc46f1f94748bac4661fce020a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:39.975137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.975884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d1cafaa-61ad-4db6-9ede-fc95c665bad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:39.980987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 787/1612] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:39 2022] DELETE /identity/v3/projects/cfeccc46f1f94748bac4661fce020a3d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:39.983577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a03bf-3402-4fa9-a528-f51df44327c6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:39.983886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a03bf-3402-4fa9-a528-f51df44327c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:39.984157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a03bf-3402-4fa9-a528-f51df44327c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:39.988099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9baa-f64f-438f-934d-1d00a6574347 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.007790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-096a03bf-3402-4fa9-a528-f51df44327c6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:40.009108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-096a03bf-3402-4fa9-a528-f51df44327c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.097473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 788/1613] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:40.105468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.106024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.106510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.129151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.130302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.130799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.131260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.132147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.136932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.144615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:40.145876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.156112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 789/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:40.162258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.172511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 826/1615] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:40.173861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.176652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.197578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43603-ded3-4bd7-aa22-d34a5fbd02c0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.198074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3b10f-e552-414a-89bc-3aae6bbc128e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.203936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.207137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.207417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.207687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.208364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:40.208715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.211827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.212770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.213414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.213696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.214151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.214815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.216963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.239104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 790/1616] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:40.241061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.257572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 827/1617] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:40.259264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.267346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb87b8d-edd1-4373-b000-d6fc128658f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.273083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a04f53-21ff-4bfe-9d8c-68929601a618 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.275486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.276114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.276523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.276911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.277700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.277894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.278896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.279094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.279469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] PATH_INFO: `/v3/projects/23010cc1581242d1a2f7ecfaea288a9e/users/ca72ccdd957043c8b4b0595dee2d577c/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.279868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.305084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23010cc1581242d1a2f7ecfaea288a9e, user_id=ca72ccdd957043c8b4b0595dee2d577c, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.309966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed98db-3190-4515-900d-eae4a8d7a890 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.310552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:40.331299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 791/1618] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:40.334526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.354832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 828/1619] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:40 2022] PUT /identity/v3/projects/23010cc1581242d1a2f7ecfaea288a9e/users/ca72ccdd957043c8b4b0595dee2d577c/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:40.368150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.368945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.369279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.427577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] MFA Rules not processed for user `ca72ccdd957043c8b4b0595dee2d577c`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:40.431756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.475925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:40.519700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa75d-ae4a-49b8-a3cb-4f5746e0acef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.560854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 829/1620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:40.561731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.564219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.601460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.602220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.602651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.603025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.604890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.607289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc649fb4-dfeb-4fc4-85a2-0ce1bd469536 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.644576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 792/1621] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:40.644576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.644576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.644576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.657066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a977c-2b92-46b1-b6b3-98a9d1426336 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.663809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.664443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.664784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.665058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] PATH_INFO: `/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.666482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb70a6b6555423dae9fd93b3fd9f7b1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.668384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.669616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] MFA Rules not processed for user `d1f15f28bba84ac89fd9902dfe168468`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:40.670884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.739337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 793/1622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:40.740304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.744425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb70a6b6555423dae9fd93b3fd9f7b1', 'request_id': 'req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:40.751689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab0f1-65b0-4612-ae1e-d4717f7a57e1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.755752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb70a6b6555423dae9fd93b3fd9f7b1', 'request_id': 'req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:40.765183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb70a6b6555423dae9fd93b3fd9f7b1', 'request_id': 'req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:40.798666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] The token cache is being invalidate because project dcb70a6b6555423dae9fd93b3fd9f7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:40.799830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:40.800762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:40.803291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 830/1623] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:40 2022] DELETE /identity/v3/projects/dcb70a6b6555423dae9fd93b3fd9f7b1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:40.804730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.806087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.812823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:40.841253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:40.842233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.842519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.842795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.843438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:40.845409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d3c50-de9e-410e-a72e-11510049b370 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:40.876104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:40.880856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 794/1624] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:40.882182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:40.882473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:40.882772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:40.899851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c30fe-0c02-4fc1-ae94-f30ca87d1bd0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:40.905791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:40.907110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:40.994945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 795/1625] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:40.994945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:40.994945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:41.004291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7c32-4950-4855-89c5-368d367e31cb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.009530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.010237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.010522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.010795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.011491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.014101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e96b-40d5-430e-8a10-c8cc5c9920c2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.043921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 796/1626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:40 2022] POST /identity/v3/users => generated 299 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:41.043921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.043921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.043921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.068747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:41.070387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:41.082955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 797/1627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:41.082955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.094394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468801e3-52a0-4b66-99cb-be9df2906f7c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.094951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.096530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.096818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.097197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.098475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.101428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.101836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.102448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.102859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.103134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.103779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.105417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.117919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 831/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.119211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.122489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 798/1629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.123493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.130638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5a723-0aa6-4267-81a5-6a2c0d068a79 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.135722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.136620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.137201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.137801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.138275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079c99-75ea-46c1-8d6a-566b8e84bfef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.139027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:41.139527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.141617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.144827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.145447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.145903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.146181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.146880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.150846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.162101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 832/1630] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:41.163921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.165642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 799/1631] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.166534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.176869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8c28-f2aa-4414-980f-eac6c60c36e6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.181574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b5da5-bb73-49b0-8a9d-23eeedeebadd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.183357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.184386 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.184958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.185490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] PATH_INFO: `/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f/users/6d84be84d98642dfad5f83080d22d6d5/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.187199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.187929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.188818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.188818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.189860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.192790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.207742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4c4a45af294bfbb5655032da9bcc3f, user_id=6d84be84d98642dfad5f83080d22d6d5, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.211706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.229923 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 800/1632] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:41.229923 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.236965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 833/1633] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:41 2022] PUT /identity/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f/users/6d84be84d98642dfad5f83080d22d6d5/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:41.237594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.324851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c95b-3e48-4fac-9732-3451596d573b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.329898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.331164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.331592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.331872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.332373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cfbab-a040-468f-803b-56568145ca02 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.332548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.334457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.337134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.337794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.338077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.338353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] PATH_INFO: `/v3/projects/22fed7fed13f48738db39bb15e047c07/users/851b6bae9c59400fb8549cfe3c8f2cf9/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.340802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:41.358096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 834/1634] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:41.358910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.361435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fed7fed13f48738db39bb15e047c07, user_id=851b6bae9c59400fb8549cfe3c8f2cf9, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.364293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.370351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863595-156c-4bbd-9dee-23b68d82136a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.375421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.376032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.376445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.376781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.377485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.378226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 801/1635] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:41 2022] PUT /identity/v3/projects/22fed7fed13f48738db39bb15e047c07/users/851b6bae9c59400fb8549cfe3c8f2cf9/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:41.385144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6f4d0-75ed-4155-b291-cde38b165e04 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.388375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.399022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 835/1636] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.400357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db2f-9b5d-4ca0-a190-b4bdde3b38a8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.400670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db2f-9b5d-4ca0-a190-b4bdde3b38a8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.400946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db2f-9b5d-4ca0-a190-b4bdde3b38a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.453250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fd04db2f-9b5d-4ca0-a190-b4bdde3b38a8 None None] MFA Rules not processed for user `851b6bae9c59400fb8549cfe3c8f2cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:41.456572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fd04db2f-9b5d-4ca0-a190-b4bdde3b38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:41.481453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b14e-d672-4724-b28a-904924ed5109 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.489857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.490510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.490866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.491210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.491985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.494255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.511551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 802/1637] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.512441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.517334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:41.526991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0d0b-6437-489d-a879-721978065f6b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.532585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.533695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.534021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.534399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] PATH_INFO: `/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f/users/6d84be84d98642dfad5f83080d22d6d5/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.536872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4c4a45af294bfbb5655032da9bcc3f, user_id=6d84be84d98642dfad5f83080d22d6d5, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.541840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.565931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 803/1638] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:41 2022] PUT /identity/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f/users/6d84be84d98642dfad5f83080d22d6d5/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:41.565931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.618970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 836/1639] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:41.620582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.620877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.621154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.657054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032092-4cd5-4e89-816e-e170d4f7f74e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.661425 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] MFA Rules not processed for user `6d84be84d98642dfad5f83080d22d6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:41.662726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:41.665603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.666285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.666565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.666838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.667611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.669464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.702916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 804/1640] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:41.703474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.717011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e89a31-6878-4db0-b78c-14104eace1a1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.727098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.728672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.730336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.730815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.731418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.734102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.777710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 805/1641] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:41.779049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.847087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:41.889390 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 837/1642] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:41.894499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.899926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7282a-c752-4e3b-a291-d4e7593f6ce9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.908272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaedc0-8eaf-4c91-949b-16f533e0164e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:41.912433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.914541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.915695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:41.915801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.917096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] PATH_INFO: `/v3/projects/51e71dd297334b15833261a3c948ebac/users/0f9f68744d084759aff501b5e98c11ec/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.917307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:41.917307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:41.917632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:41.918454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.920919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.950565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e71dd297334b15833261a3c948ebac, user_id=0f9f68744d084759aff501b5e98c11ec, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:41.960023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:41.970598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 838/1643] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:41 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:41.971910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:41.974330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:41.991632 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 806/1644] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:41 2022] PUT /identity/v3/projects/51e71dd297334b15833261a3c948ebac/users/0f9f68744d084759aff501b5e98c11ec/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:41.992481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.081663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272840a5-13ac-4055-9d69-9a020f1a6d97 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.094882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7da1-003c-426b-8e0c-3a7d5ba292f2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.102846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.103454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.103745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.104159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.104882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.106528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836783a-67f8-43a6-9d1f-149534500dcb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.118329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 807/1645] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:42.119820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.120210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.120622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.136285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:42.145968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.146644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.146926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.147198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.151657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] MFA Rules not processed for user `0f9f68744d084759aff501b5e98c11ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:42.152955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:42.220565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.222258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5383ca-4030-4999-ac4b-7440bae7d2a2 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.228149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 808/1646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:42.232598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.233845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 839/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:42.234995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41d0e3-94e8-4a79-b0b4-bc6558f53af8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.235270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41d0e3-94e8-4a79-b0b4-bc6558f53af8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.235545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41d0e3-94e8-4a79-b0b4-bc6558f53af8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.237865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 840/1648] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:21:42.239213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41d0e3-94e8-4a79-b0b4-bc6558f53af8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.246067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630148-9f5f-45bf-a38e-d27cf0517794 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.255658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.256930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.257250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.257520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.258169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.259405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41d0e3-94e8-4a79-b0b4-bc6558f53af8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.261746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb00a41-0286-4766-b8ed-a84e0baa89b1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.267681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.271009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.271009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.271009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.271623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.279953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 809/1649] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:42.280287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.280361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.280361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.286745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.312553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:42.314121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:42.318323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 841/1650] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:42.318323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.379020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:42.408062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8bc68-0d00-4d8c-9b24-90566fe3701c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.415965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.416889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.417175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.417454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] PATH_INFO: `/v3/projects/f3b361ff79c943bf80415bc584e6a720/users/e6227335f7c543199dff9ca352a2d46a/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.442291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b361ff79c943bf80415bc584e6a720, user_id=e6227335f7c543199dff9ca352a2d46a, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.445548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 810/1651] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:42.446725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.447607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.463898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7cb86-2e7d-46d9-9826-a2e0fcc435c2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.483845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 842/1652] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:42 2022] PUT /identity/v3/projects/f3b361ff79c943bf80415bc584e6a720/users/e6227335f7c543199dff9ca352a2d46a/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:42.485798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.497548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:42.567491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.568122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.568479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.568956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.569609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.571556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d84395-2a89-4f50-b704-b4c30486f775 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.585483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:42.606089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 811/1653] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:42.606089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.606089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.606089 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.625015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b9b6-25db-45a7-9f5f-8f1b0213ca65 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.631615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.632360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.639934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.640263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.645559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] MFA Rules not processed for user `e6227335f7c543199dff9ca352a2d46a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:42.647346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:42.650781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.652710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.681433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 843/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:42.682487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.704335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f979b6-4ee2-499e-9535-920582228f3c service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.711365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.711984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.712637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.712983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.713578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.715690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.732201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 844/1655] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:42.738608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.743280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 812/1656] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:42.744344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.750240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db4b9-8402-482d-90d2-3777406ef214 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.757792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24704283-fd3c-4ecf-bf93-e761013ee4cc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:42.759411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.760526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.761257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.761537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] PATH_INFO: `/v3/projects/6c6ebbc64e054ab2b96addc388a50073/users/74c03574d4d44651b826a75d64708c6b/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.769753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:42.771366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:42.771758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:42.772659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:42.783711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.789538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6ebbc64e054ab2b96addc388a50073, user_id=74c03574d4d44651b826a75d64708c6b, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:42.797627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.799894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:42.828484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 845/1657] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:42 2022] PUT /identity/v3/projects/6c6ebbc64e054ab2b96addc388a50073/users/74c03574d4d44651b826a75d64708c6b/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:42.835451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.856553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 813/1658] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:42.862669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:42.946507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:43.010756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5145e-5d72-4d9a-b636-2c8311d3a1aa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.014021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fe4a-026d-4b41-91ff-bf25cc2dccd1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.022534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.025613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.026179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.026562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.027388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.030194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.036756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.037312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.037592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.037865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.038513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.046499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 846/1659] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:43.051922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.053253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.063119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99648-c60b-4303-9cac-a147fa4de454 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.093207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.095322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.096937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.097414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] PATH_INFO: `/v3/projects/6c6ebbc64e054ab2b96addc388a50073/users/74c03574d4d44651b826a75d64708c6b/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.101786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6ebbc64e054ab2b96addc388a50073, user_id=74c03574d4d44651b826a75d64708c6b, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.107619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8278fa-2933-44e9-b32e-4387f5949eed admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.109383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 814/1660] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:42 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:43.113321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.133587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016f5c-70e1-41c9-8f40-3c58cfc1d6a1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.155833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 847/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:43 2022] PUT /identity/v3/projects/6c6ebbc64e054ab2b96addc388a50073/users/74c03574d4d44651b826a75d64708c6b/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:43.158682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.159218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.159693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.211706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] MFA Rules not processed for user `74c03574d4d44651b826a75d64708c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:43.213861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.217048 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.217912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.218231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.218677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.219856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.223937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.241060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 815/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:43.242441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.263396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185564c-a340-4f86-a2fd-95ac38a2229a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.276336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.277518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.277800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.278691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] PATH_INFO: `/v3/users/ca72ccdd957043c8b4b0595dee2d577c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.280633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca72ccdd957043c8b4b0595dee2d577c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.282585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.359020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca72ccdd957043c8b4b0595dee2d577c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:43.378615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 848/1663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:43.383658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca72ccdd957043c8b4b0595dee2d577c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:43.384718 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.398041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950add1-366e-4307-8b1c-ec8687bb3f1b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.403942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.405348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.405764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.406109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] PATH_INFO: `/v3/projects/8d9fff5b596f42e18eb9036cb844f135/users/d08bdf15051746289672a796bfb53484/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.417176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca72ccdd957043c8b4b0595dee2d577c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:43.420879 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca72ccdd957043c8b4b0595dee2d577c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:43.422535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:43.430912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9fff5b596f42e18eb9036cb844f135, user_id=d08bdf15051746289672a796bfb53484, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.436253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca72ccdd957043c8b4b0595dee2d577c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:43.436360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8caa3-65d1-4fe9-a20d-d63d90b3764d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.448234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 816/1664] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:43 2022] DELETE /identity/v3/users/ca72ccdd957043c8b4b0595dee2d577c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:43.449274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.452369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.462355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 849/1665] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:43 2022] PUT /identity/v3/projects/8d9fff5b596f42e18eb9036cb844f135/users/d08bdf15051746289672a796bfb53484/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:43.463825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.464166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.464537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.493237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:43.494605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.511788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:43.581021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7136b5-8962-40b5-95af-a27f0014ee59 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.604381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 850/1666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:43.606356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.608135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.621569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae8dd-6281-4f65-8cb0-5251f47a5af1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.630515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.631680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.632065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.632480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.633254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.635641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.650697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 851/1667] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:43.655345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.675227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae890-72dd-4cd4-8f9f-159cf6606a7c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.689257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.689981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.690260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.690533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] PATH_INFO: `/v3/projects/8d9fff5b596f42e18eb9036cb844f135/users/d08bdf15051746289672a796bfb53484/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.696398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9fff5b596f42e18eb9036cb844f135, user_id=d08bdf15051746289672a796bfb53484, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.699636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.713137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 852/1668] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:43 2022] PUT /identity/v3/projects/8d9fff5b596f42e18eb9036cb844f135/users/d08bdf15051746289672a796bfb53484/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:43.714057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:43.723755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.724801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.725084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.725322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.725695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.727587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.823716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.825239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bf22-0433-4401-b0d6-7ce9167b0640 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:43.836225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4864d71-95cc-4a71-8d84-6f8731b05e2a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:43.840736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:43.841389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.841668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.842761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.844421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 817/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:43.845621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:43.845903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:43.846194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:43.938700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] MFA Rules not processed for user `d08bdf15051746289672a796bfb53484`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:43.940558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:43.969319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:43.971503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.007178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 853/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:44.008772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.036996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:44.044657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 818/1671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:44.060074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.061541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.096635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:44.101644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3818-2075-4042-97c5-77207d63e136 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.110771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.111252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.111682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.111971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.116237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.194908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aaa91-455e-4512-9873-2df2686f03a5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.205157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.206508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.206796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.207078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.220337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.222929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.234101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 854/1672] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:44.234690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.236301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.257737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 819/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:44.332154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.353633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7ea0c-e40c-4d91-a7ae-5956c4d8278c service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.358688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.359724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.360075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.360682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.363304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.442352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.445791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.460193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 855/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:44.475024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.476478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.493341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf74b99-9a9f-4941-aafb-3fce742cf20b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.498424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.499067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.499347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.499657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] PATH_INFO: `/v3/projects/23010cc1581242d1a2f7ecfaea288a9e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.500965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23010cc1581242d1a2f7ecfaea288a9e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.503034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.572766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23010cc1581242d1a2f7ecfaea288a9e', 'request_id': 'req-95f4078b-d44e-4493-8fc7-513ee8929c3f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.581517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23010cc1581242d1a2f7ecfaea288a9e', 'request_id': 'req-95f4078b-d44e-4493-8fc7-513ee8929c3f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.589637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23010cc1581242d1a2f7ecfaea288a9e', 'request_id': 'req-95f4078b-d44e-4493-8fc7-513ee8929c3f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.605283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.606716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.610399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] The token cache is being invalidate because project 23010cc1581242d1a2f7ecfaea288a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:44.610900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.613038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.615045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 820/1675] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:44 2022] DELETE /identity/v3/projects/23010cc1581242d1a2f7ecfaea288a9e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:44.619597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.621236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.624595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70ce2-184a-4310-90aa-ed568f4196ae service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.695381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.696260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.696990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.696990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] PATH_INFO: `/v3/users/0f9f68744d084759aff501b5e98c11ec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.698279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9f68744d084759aff501b5e98c11ec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.700532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.714557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:44.739865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4078b-d44e-4493-8fc7-513ee8929c3f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:44.746605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:44.747417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.747790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.748139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] PATH_INFO: `/v3/users/6d84be84d98642dfad5f83080d22d6d5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.750206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d84be84d98642dfad5f83080d22d6d5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:44.753043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:44.783262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9f68744d084759aff501b5e98c11ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.808144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9f68744d084759aff501b5e98c11ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.816977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9f68744d084759aff501b5e98c11ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.824616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9f68744d084759aff501b5e98c11ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.825661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ed4b45dc-767b-41c2-8962-8d9da6280971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9f68744d084759aff501b5e98c11ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.832315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:44.834385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 856/1676] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:44 2022] DELETE /identity/v3/users/0f9f68744d084759aff501b5e98c11ec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:44.837681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d84be84d98642dfad5f83080d22d6d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.839081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:44.839526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:44.840006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:44.847330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d84be84d98642dfad5f83080d22d6d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.860429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d84be84d98642dfad5f83080d22d6d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.861620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d84be84d98642dfad5f83080d22d6d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.863953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:44.865166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:44.872159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d84be84d98642dfad5f83080d22d6d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:44.882439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 821/1677] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:44 2022] DELETE /identity/v3/users/6d84be84d98642dfad5f83080d22d6d5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:44.942264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 857/1678] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:44.951650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:44.953167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.059101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190769b-ab13-4dfd-9bfe-23c0d6ce5fdd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:45.064202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:45.064910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.065161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.065591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.161380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:45.163131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daffe0-5df6-4831-9e4f-4d1529622d27 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:45.186796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 822/1679] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:45.415434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:45.415434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.441261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0865-dec2-4bc2-86cb-4680183609b3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:45.454921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:45.462697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.464735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.465057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] PATH_INFO: `/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.466974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4c4a45af294bfbb5655032da9bcc3f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:45.470406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:45.616057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4c4a45af294bfbb5655032da9bcc3f', 'request_id': 'req-22babfb4-599e-4585-9e88-103272cdfd31'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.625253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4c4a45af294bfbb5655032da9bcc3f', 'request_id': 'req-22babfb4-599e-4585-9e88-103272cdfd31'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.633320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4c4a45af294bfbb5655032da9bcc3f', 'request_id': 'req-22babfb4-599e-4585-9e88-103272cdfd31'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.648814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] The token cache is being invalidate because project 9e4c4a45af294bfbb5655032da9bcc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:45.649117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.649842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.651616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 858/1680] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:45 2022] DELETE /identity/v3/projects/9e4c4a45af294bfbb5655032da9bcc3f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:45.657004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74ef3c-47a2-4a7e-af26-ffadd2cbf585 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.657519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74ef3c-47a2-4a7e-af26-ffadd2cbf585 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.657607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74ef3c-47a2-4a7e-af26-ffadd2cbf585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.684877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3e74ef3c-47a2-4a7e-af26-ffadd2cbf585 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:45.686904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e74ef3c-47a2-4a7e-af26-ffadd2cbf585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.716093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:45.717567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.734458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:45.788824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 823/1681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:45.797243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.797708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.798146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.802456 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babfb4-599e-4585-9e88-103272cdfd31 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:45.815185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:45.816129 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.816408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.816716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] PATH_INFO: `/v3/projects/51e71dd297334b15833261a3c948ebac` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.818011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e71dd297334b15833261a3c948ebac)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:45.820031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:45.821258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.823769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:45.829848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 824/1682] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:45.834647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:45.841025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:45.850258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d8829-32fd-4af8-b65d-7d660963ecdd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:45.856996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:45.858548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.858548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.858548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.859225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:45.859530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:45.861353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:45.884485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 825/1683] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:45.886098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:45.895024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e71dd297334b15833261a3c948ebac', 'request_id': 'req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.899376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7476fd-1420-475f-8976-500a00b0df67 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:45.907311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e71dd297334b15833261a3c948ebac', 'request_id': 'req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.918855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e71dd297334b15833261a3c948ebac', 'request_id': 'req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.936955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] The token cache is being invalidate because project 51e71dd297334b15833261a3c948ebac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:45.937306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.937999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:45.939900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 859/1684] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:45 2022] DELETE /identity/v3/projects/51e71dd297334b15833261a3c948ebac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:45.944020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:45.945532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:45.993370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:45.994623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:45.995100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:45.995544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:45.996968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.000834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.039162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 826/1685] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:45 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:46.044199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:46.046202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:46.050714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c403a-93fa-4bd7-9e97-2fd4d9658b3b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:46.133438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:46.169651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:46.171428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.171850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.172019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] PATH_INFO: `/v3/users/74c03574d4d44651b826a75d64708c6b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.173704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c03574d4d44651b826a75d64708c6b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.175989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.223272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88a266-ce68-4433-b044-a29705d14cb3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:46.243974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:46.244640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.245028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.245433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.247227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.250496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.289387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c03574d4d44651b826a75d64708c6b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:46.301123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 827/1686] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:46 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:46.316942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:46.320838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c03574d4d44651b826a75d64708c6b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:46.339379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dba5a-c02a-49f8-8d27-7d5e76703a99 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:46.344968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c03574d4d44651b826a75d64708c6b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:46.348953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:46.349615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.349899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.350171 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.356450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.358601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.366013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c03574d4d44651b826a75d64708c6b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:46.366870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c03574d4d44651b826a75d64708c6b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:46.401034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 860/1687] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:45 2022] DELETE /identity/v3/users/74c03574d4d44651b826a75d64708c6b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:46.406028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 828/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:46.410195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:46.411681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:46.572815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ee79-4086-4f85-a7aa-7aee48e132c8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:46.596412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:46.597165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.597453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.597735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.600697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.605837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea1a6-0be0-4347-a245-52fb4c704cbc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.630362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 861/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:46.634522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:46.654152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04332-b0d4-4d0e-b68d-540b1c1f3774 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:46.663844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:46.666976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.667690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.669928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] PATH_INFO: `/v3/projects/e38a86d3b4214b2dbccae1761eda442f/users/7c3bc51203404fb394ba35b101eabe1a/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.704344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a86d3b4214b2dbccae1761eda442f, user_id=7c3bc51203404fb394ba35b101eabe1a, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:46.715111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:46.754266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 829/1690] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:46 2022] PUT /identity/v3/projects/e38a86d3b4214b2dbccae1761eda442f/users/7c3bc51203404fb394ba35b101eabe1a/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:46.765490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:46.766004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:46.766432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:46.862920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] MFA Rules not processed for user `7c3bc51203404fb394ba35b101eabe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:46.864790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:47.001380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:47.035900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 862/1691] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:47.044997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:47.047035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:47.092778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:47.129999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ae311-ab85-4a9d-9f48-acc61d4b23c0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:47.135876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:47.136556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:47.136846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:47.137177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:47.150829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:47.152443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64974f4a-bcdb-486e-bce0-d04f3a2d5d6e service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:47.164249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 830/1692] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:47.686254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:47.688511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:47.769226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3832b-a965-42a9-92c4-fafd53af3212 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:47.774264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:47.774952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:47.775235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:47.775506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] PATH_INFO: `/v3/projects/6c6ebbc64e054ab2b96addc388a50073` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:47.776667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6ebbc64e054ab2b96addc388a50073)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:47.778739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:47.842695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6ebbc64e054ab2b96addc388a50073', 'request_id': 'req-a273a077-7b03-46d0-9331-9d625597a1cf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:47.865987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6ebbc64e054ab2b96addc388a50073', 'request_id': 'req-a273a077-7b03-46d0-9331-9d625597a1cf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:47.873811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6ebbc64e054ab2b96addc388a50073', 'request_id': 'req-a273a077-7b03-46d0-9331-9d625597a1cf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:47.898231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] The token cache is being invalidate because project 6c6ebbc64e054ab2b96addc388a50073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:47.898531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:47.899212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:47.901547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 863/1693] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:47 2022] DELETE /identity/v3/projects/6c6ebbc64e054ab2b96addc388a50073 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:47.907018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ea08-54d4-4911-bbd8-12658f1e0d5a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:47.907435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ea08-54d4-4911-bbd8-12658f1e0d5a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:47.907570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526ea08-54d4-4911-bbd8-12658f1e0d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:47.949835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e526ea08-54d4-4911-bbd8-12658f1e0d5a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:47.951298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e526ea08-54d4-4911-bbd8-12658f1e0d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:47.954452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:47.958607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.041300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 831/1694] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:48.050144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.050506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.050844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.076298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:48.077798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.091885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 832/1695] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:48.095015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a077-7b03-46d0-9331-9d625597a1cf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.098408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.100865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.102293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.102649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.102995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] PATH_INFO: `/v3/users/851b6bae9c59400fb8549cfe3c8f2cf9` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.105159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851b6bae9c59400fb8549cfe3c8f2cf9)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.109930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.115240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577033f2-9f4e-4d25-8056-e8658962336d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.126001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.128344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.128755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.130749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.131515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:48.131909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.139593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.171848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 833/1696] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:48.174566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.182833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:48.197244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c130d-07b0-4d28-adcc-074dd256717b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.203323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.204158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.204661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.205177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.206164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.208324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.224353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851b6bae9c59400fb8549cfe3c8f2cf9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:48.245986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851b6bae9c59400fb8549cfe3c8f2cf9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:48.255454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851b6bae9c59400fb8549cfe3c8f2cf9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:48.266378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 834/1697] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:48.268443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.268574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851b6bae9c59400fb8549cfe3c8f2cf9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:48.269276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abc14e6b-0b95-4642-847f-e766d3fe8ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851b6bae9c59400fb8549cfe3c8f2cf9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:48.276243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.279344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 864/1698] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:47 2022] DELETE /identity/v3/users/851b6bae9c59400fb8549cfe3c8f2cf9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:48.284114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.284621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.285213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.331054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:48.333181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.431587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 865/1699] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:48.434015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ae65-a34d-4a8b-bcce-10fb96a12195 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.441553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.442312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.442701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.443770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.443770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.446253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.450635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.453016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.477423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 835/1700] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:48.482992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.496972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99dcfc-5418-49f0-abad-fa0c20abae4c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.504141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.504844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.505130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.505411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.506066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.507687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.524642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 836/1701] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:48.527630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.542103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61bf81-5139-4874-a8cb-35daaed8edb2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.544045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d197c-9210-4347-b376-b08449f58330 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.552045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.552733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.552950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.553091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.553282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.554068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.554180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.554591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.555010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.555761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.561909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:48.573100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 837/1702] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:21:48.579755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.584128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.585600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39643e91-fb0c-43c5-9cc6-d29d6f02a510 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.598501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c66e-361d-43e6-be48-f53c029f77ce admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.599147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 866/1703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:48.604874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.605555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.605978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.606260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] PATH_INFO: `/v3/projects/50467d21a4824fcaab7e98beb90fae71/users/0cb4349fd92249c2ab72065b16be5ea6/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.624416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50467d21a4824fcaab7e98beb90fae71, user_id=0cb4349fd92249c2ab72065b16be5ea6, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.627892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:48.648549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 838/1704] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:48 2022] PUT /identity/v3/projects/50467d21a4824fcaab7e98beb90fae71/users/0cb4349fd92249c2ab72065b16be5ea6/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:48.655810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.657211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.657561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.693608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] MFA Rules not processed for user `0cb4349fd92249c2ab72065b16be5ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:48.697940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:48.744940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:48.822455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:48.823471 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 867/1705] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:48.942059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adad5c-52e5-40b8-b5b2-f9ec263c6259 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:48.951084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:48.952556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:48.953014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:48.953388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:48.954136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:48.957135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.002832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.013692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 839/1706] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:48 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:49.042797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255235f-bdaa-471d-9188-f2fb535efc29 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.125315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.126024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.126306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.126492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.127558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.129942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.156778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 868/1707] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:49 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:49.161010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.172281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19889-8ac4-466e-b37d-bcef70161d62 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.177721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.178343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.178623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.178897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.179553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.181356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.193708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 840/1708] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:49.199787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.217260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15779c-c434-4376-90a3-a966380a0563 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.225953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.226689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.227305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.227590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] PATH_INFO: `/v3/projects/0ba02e52fdee4ce88870841193a47d40/users/748395587ddb42d7b8322b9e4b356b29/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.247659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba02e52fdee4ce88870841193a47d40, user_id=748395587ddb42d7b8322b9e4b356b29, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.251878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.268313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 869/1709] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:49 2022] PUT /identity/v3/projects/0ba02e52fdee4ce88870841193a47d40/users/748395587ddb42d7b8322b9e4b356b29/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:49.272438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.284211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443fdc1-c35a-4743-89db-fb0c01c1f9c3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.358843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.359460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.359741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.360016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.360693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.362733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df8115-81b6-40f3-81ba-ec80bfd4954b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.374153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 841/1710] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:21:49.380106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.391511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0319-ac22-42e8-a434-539bd251ef9f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.397609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.398315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.398573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.398849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] PATH_INFO: `/v3/projects/0ba02e52fdee4ce88870841193a47d40/users/748395587ddb42d7b8322b9e4b356b29/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.401103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba02e52fdee4ce88870841193a47d40, user_id=748395587ddb42d7b8322b9e4b356b29, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.403846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.417038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 870/1711] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:49 2022] PUT /identity/v3/projects/0ba02e52fdee4ce88870841193a47d40/users/748395587ddb42d7b8322b9e4b356b29/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:49.426960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.427289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.427565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.464369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] MFA Rules not processed for user `748395587ddb42d7b8322b9e4b356b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:49.466049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:49.514254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:49.557982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 842/1712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:49.569345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.572049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:49.637425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.639069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:49.657984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f44cf-5e8a-4a5a-bb25-c92be8192ee4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.666820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.668023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.668748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.669571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.734985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:49.761436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.763344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.781361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5a0f-d4fc-48d8-bda7-cddefd4f2835 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:49.787136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:49.787791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:49.788071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:49.788347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] PATH_INFO: `/v3/projects/22fed7fed13f48738db39bb15e047c07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:49.789707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fed7fed13f48738db39bb15e047c07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:49.793902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:49.819930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 871/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:49.873354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fed7fed13f48738db39bb15e047c07', 'request_id': 'req-3444521e-c667-49dd-a550-668d8de44dd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:49.883235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fed7fed13f48738db39bb15e047c07', 'request_id': 'req-3444521e-c667-49dd-a550-668d8de44dd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:49.891732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fed7fed13f48738db39bb15e047c07', 'request_id': 'req-3444521e-c667-49dd-a550-668d8de44dd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:49.907596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] The token cache is being invalidate because project 22fed7fed13f48738db39bb15e047c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:49.908830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:49.910625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:49.912496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 843/1714] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:49 2022] DELETE /identity/v3/projects/22fed7fed13f48738db39bb15e047c07 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:49.916571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:49.933945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40cb2-78c8-499f-ad61-01f99282b6b0 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:50.076421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:50.077113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:50.077399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:50.077678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] PATH_INFO: `/v3/users/e6227335f7c543199dff9ca352a2d46a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:50.082803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6227335f7c543199dff9ca352a2d46a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:50.085235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:50.192980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6227335f7c543199dff9ca352a2d46a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:50.235772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6227335f7c543199dff9ca352a2d46a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:50.265011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6227335f7c543199dff9ca352a2d46a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:50.288672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6227335f7c543199dff9ca352a2d46a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:50.290980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6227335f7c543199dff9ca352a2d46a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:50.311273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 872/1715] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:49 2022] DELETE /identity/v3/users/e6227335f7c543199dff9ca352a2d46a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:51.038009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:51.039511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:51.058129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444521e-c667-49dd-a550-668d8de44dd0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:51.151715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:51.152428 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:51.152804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:51.153146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] PATH_INFO: `/v3/projects/f3b361ff79c943bf80415bc584e6a720` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:51.155498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b361ff79c943bf80415bc584e6a720)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:51.157860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:51.161246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:51.226409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b361ff79c943bf80415bc584e6a720', 'request_id': 'req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.234493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b361ff79c943bf80415bc584e6a720', 'request_id': 'req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.244546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b361ff79c943bf80415bc584e6a720', 'request_id': 'req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.257529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] The token cache is being invalidate because project f3b361ff79c943bf80415bc584e6a720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:51.257842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.258533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.260157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 844/1716] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:51 2022] DELETE /identity/v3/projects/f3b361ff79c943bf80415bc584e6a720 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:51.264142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:51.265846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:51.279778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586044b-a57f-49a8-b476-4f41fec6aea8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:51.345179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:51.346733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:51.347275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:51.347770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] PATH_INFO: `/v3/users/d08bdf15051746289672a796bfb53484` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:51.349047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08bdf15051746289672a796bfb53484)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:51.350998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:51.355408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:51.421966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08bdf15051746289672a796bfb53484'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.436902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08bdf15051746289672a796bfb53484'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.445223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08bdf15051746289672a796bfb53484'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.460142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08bdf15051746289672a796bfb53484'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.461180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b85ce5e4-70ed-426f-af80-31224d26b3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08bdf15051746289672a796bfb53484'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:51.468083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 873/1717] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:51 2022] DELETE /identity/v3/users/d08bdf15051746289672a796bfb53484 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:52.071751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.073234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:52.093972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa6cc-1505-47bb-a16e-7229fcd16f63 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.201187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.201836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.202120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.202386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] PATH_INFO: `/v3/projects/8d9fff5b596f42e18eb9036cb844f135` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.203622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9fff5b596f42e18eb9036cb844f135)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.205895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.267866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9fff5b596f42e18eb9036cb844f135', 'request_id': 'req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:52.278487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9fff5b596f42e18eb9036cb844f135', 'request_id': 'req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:52.288766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9fff5b596f42e18eb9036cb844f135', 'request_id': 'req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:52.303947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] The token cache is being invalidate because project 8d9fff5b596f42e18eb9036cb844f135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:52.304251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:52.305241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38bea768-b3ce-4ab2-9fe4-edaf6c40c7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:52.310938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 845/1718] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:52 2022] DELETE /identity/v3/projects/8d9fff5b596f42e18eb9036cb844f135 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:52.313089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.313543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.313617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.357150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:52.359962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:52.460513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 874/1719] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:52.464356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.464841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.465222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.489055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:52.490442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:52.499224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 846/1720] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:52.504048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.515876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1160-a9bd-4532-9fe4-1e5f647a6002 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.523549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.524187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.524485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.524779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.525497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:52.525809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.527951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.555664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 875/1721] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:52.560552 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.570937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3797e-41ca-4b6a-aba5-b3cfc017c75d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.575678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.576288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.576597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.576870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.577501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.579406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.600837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:52.617567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 847/1722] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:52.622080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.635650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1815e-42f5-45c4-90c0-4260191ae473 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.711572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.711572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.711572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.711572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.711968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.711968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.724387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:52.733312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 876/1723] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:52 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:52.736706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.747701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c80d3-7164-4249-9be0-618623e7678c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.752429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.753058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.753335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.753602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.754235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.755823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.766786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 848/1724] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:52.771751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.786294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bbea7-ef38-463a-886c-875cba0a487e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.791355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.791966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.792244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.792991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.793189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.794789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b93e0-0471-4c46-87be-7e8b9b6150a5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.805999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 877/1725] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:52.810144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.820671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899c2b7-ff98-4fc5-97fc-b303e983e90b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:52.825467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:52.826118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.826395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.826661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] PATH_INFO: `/v3/projects/a923e16a17ef41598e4dd52ca37b86f3/users/5f79cf37088a41089cd63fdbe047111d/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.841962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a923e16a17ef41598e4dd52ca37b86f3, user_id=5f79cf37088a41089cd63fdbe047111d, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:52.844635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:52.858097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 849/1726] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:52 2022] PUT /identity/v3/projects/a923e16a17ef41598e4dd52ca37b86f3/users/5f79cf37088a41089cd63fdbe047111d/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:52.869436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:52.869720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:52.870002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:52.900905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] MFA Rules not processed for user `5f79cf37088a41089cd63fdbe047111d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:52.902123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:52.982190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 878/1727] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:52.996620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:52.998789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.138349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d670-d921-4840-8d9b-4cdc7d34f622 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:53.143387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:53.144466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.144932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.145283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.157584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:53.161499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:53.196723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 850/1728] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:53.219852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:53.323704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1191a-ea94-41df-8ea6-516ecc708bee None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:53.328795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:53.331607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.331903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.332176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] PATH_INFO: `/v3/users/5f79cf37088a41089cd63fdbe047111d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.333460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f79cf37088a41089cd63fdbe047111d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:53.335700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:53.367992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:53.369764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.404060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3684fe-85cd-4f41-920f-dd513853addc service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:53.411840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:53.412520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.412800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.413083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] PATH_INFO: `/v3/users/7c3bc51203404fb394ba35b101eabe1a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.414387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3bc51203404fb394ba35b101eabe1a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:53.416750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:53.451057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f79cf37088a41089cd63fdbe047111d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.479515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f79cf37088a41089cd63fdbe047111d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.489597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3bc51203404fb394ba35b101eabe1a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.497259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3bc51203404fb394ba35b101eabe1a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.504348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f79cf37088a41089cd63fdbe047111d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.510247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:53.513844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f79cf37088a41089cd63fdbe047111d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.515267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1b05dc62-dbf0-4482-b39b-748f3dcb2eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f79cf37088a41089cd63fdbe047111d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.521078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3bc51203404fb394ba35b101eabe1a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.522181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3bc51203404fb394ba35b101eabe1a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.528260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 879/1729] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:53 2022] DELETE /identity/v3/users/5f79cf37088a41089cd63fdbe047111d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:53.531345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74d0f4cc-e37f-459b-8dc5-557c9441ddab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3bc51203404fb394ba35b101eabe1a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:53.533337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.533624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.533895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.545249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 851/1730] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:53 2022] DELETE /identity/v3/users/7c3bc51203404fb394ba35b101eabe1a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:53.556204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.557357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.558078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.617849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:53.623407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.651598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:53.666282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.757247 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:53.825695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 880/1731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:53.838569 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 852/1732] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:53.859175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:53.860757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.866716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:53.868485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:53.945190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1cf60-edb1-46f7-a802-2884b1d218b1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:53.951493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:53.952195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.952500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.952787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.964628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:53.966269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:53.966574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a65e3-9560-4ed6-bfca-aae740a306d1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:53.971579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:53.972528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:53.972897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:53.974502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:53.980107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 853/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:53.986672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:53.988637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:54.001905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 881/1734] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:54.868283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:54.870263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:54.901251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14831c-a5e8-4dad-bcdb-f402c0746717 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:54.911342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:54.912636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:54.913646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:54.913941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:54.914220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] PATH_INFO: `/v3/projects/a923e16a17ef41598e4dd52ca37b86f3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:54.916232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:54.917372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a923e16a17ef41598e4dd52ca37b86f3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:54.925013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:54.938663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61471b-5e9f-4c98-ab74-de3e2caec5bd service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:54.946040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:54.948046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:54.949776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:54.951846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] PATH_INFO: `/v3/projects/e38a86d3b4214b2dbccae1761eda442f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:54.955645 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38a86d3b4214b2dbccae1761eda442f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:54.957876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:54.998260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a923e16a17ef41598e4dd52ca37b86f3', 'request_id': 'req-bc0132e8-4316-4c38-b639-1b61c0230e36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.008725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a923e16a17ef41598e4dd52ca37b86f3', 'request_id': 'req-bc0132e8-4316-4c38-b639-1b61c0230e36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.015345 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38a86d3b4214b2dbccae1761eda442f', 'request_id': 'req-5e45e337-6f27-47cd-a423-c604fc662472'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.015557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a923e16a17ef41598e4dd52ca37b86f3', 'request_id': 'req-bc0132e8-4316-4c38-b639-1b61c0230e36'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.025852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38a86d3b4214b2dbccae1761eda442f', 'request_id': 'req-5e45e337-6f27-47cd-a423-c604fc662472'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.031494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] The token cache is being invalidate because project a923e16a17ef41598e4dd52ca37b86f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:55.031886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.032758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.033803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38a86d3b4214b2dbccae1761eda442f', 'request_id': 'req-5e45e337-6f27-47cd-a423-c604fc662472'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.035109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 854/1735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:54 2022] DELETE /identity/v3/projects/a923e16a17ef41598e4dd52ca37b86f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:55.035949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.037779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.047726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] The token cache is being invalidate because project e38a86d3b4214b2dbccae1761eda442f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:55.048265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.049839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5e45e337-6f27-47cd-a423-c604fc662472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:55.051842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 882/1736] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:54 2022] DELETE /identity/v3/projects/e38a86d3b4214b2dbccae1761eda442f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:55.053260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a46b-4f2c-4fda-98ce-567e79c93ab6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.054239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a46b-4f2c-4fda-98ce-567e79c93ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.054600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a46b-4f2c-4fda-98ce-567e79c93ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.079602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2f92a46b-4f2c-4fda-98ce-567e79c93ab6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:55.081317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2f92a46b-4f2c-4fda-98ce-567e79c93ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.102457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:55.116955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0132e8-4316-4c38-b639-1b61c0230e36 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.130885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:55.161837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 883/1737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:55.163258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb58a5-826b-4a41-9367-cf853e53bb1e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.163614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb58a5-826b-4a41-9367-cf853e53bb1e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.164133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb58a5-826b-4a41-9367-cf853e53bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.179270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.180408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.180790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.181131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.183490 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.189274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-41bb58a5-826b-4a41-9367-cf853e53bb1e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:55.190738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-41bb58a5-826b-4a41-9367-cf853e53bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.207790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 884/1738] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:55.207790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841839a-2eea-4392-bc8c-63ee9828a2ba None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.207790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841839a-2eea-4392-bc8c-63ee9828a2ba None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.207790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841839a-2eea-4392-bc8c-63ee9828a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.227190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7841839a-2eea-4392-bc8c-63ee9828a2ba None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:55.228487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7841839a-2eea-4392-bc8c-63ee9828a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.239254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 885/1739] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:55.240790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.241175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.241515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.271116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:55.272484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:55.274671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.276301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.281580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 886/1740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:55.285367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.294326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6b402-644d-433a-a237-a5a1df12a91c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.300014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.300757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.301128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.301406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.302067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:55.302233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 855/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:55.302389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.303162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.304278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.320978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 887/1742] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:55.326373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.331672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb2261-76af-4e93-819e-5658ebb0c8b2 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.342030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901cca-7944-4fa4-9475-5966dd646423 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.344857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.345704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.346070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.346356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.348417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:55.348893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.349520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.349891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.350063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.350324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.351083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.353423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.353771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.391001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 888/1743] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:55.396682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.398443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 856/1744] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:55.403080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.427671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3b3e2-16d0-4bd6-b4a4-6099ca879c5f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.527611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eedd8-a170-41b2-a2c5-28cc4425f7e8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.536286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.537063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.537419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.537705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.539319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.543838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.583249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 889/1745] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:55.584384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.594627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.595340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.595609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.595927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.596672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.599289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0f542-9ba7-4ded-97b1-09dc92992644 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.607607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.608309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.608309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.608604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.609263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.609389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.612061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.640063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 890/1746] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:55.641505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.660396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad7ce6-cca1-4a95-8025-f81c0a75b7a5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.684878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 857/1747] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:21:55.688036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.691106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.692154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.692521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.694205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.696284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.699587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.749029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 891/1748] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:55.753243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.797025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:55.803274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607ae91-b25a-4a7c-a1e5-a42c92e7e405 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.885302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb483-4d76-4875-8ffb-b21cb91e0c6d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:55.896210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.898209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.898764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.899319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.899711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:55.902488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:55.918974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:55.951221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 858/1749] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:55 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:55.956559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:55.969292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:55.973012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:55.973548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:55.973955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] PATH_INFO: `/v3/projects/805b89d169f2434f9dbcfc9037ef7898/users/f628e2323b0640b5866e3ec0d2486160/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:55.990700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb68488-d6f8-49f4-8ba6-aaafcafdfcf7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.004956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.006559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.007897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.008200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.009657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.009879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805b89d169f2434f9dbcfc9037ef7898, user_id=f628e2323b0640b5866e3ec0d2486160, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.015065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.017089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca377320-d7b8-48c7-9d89-7aec0b10dba6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.034886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 859/1750] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:56.038797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.043142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 892/1751] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:55 2022] PUT /identity/v3/projects/805b89d169f2434f9dbcfc9037ef7898/users/f628e2323b0640b5866e3ec0d2486160/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:56.053804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9194-9247-4683-a230-84aebb87daaa None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.054086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9194-9247-4683-a230-84aebb87daaa None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.054358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9194-9247-4683-a230-84aebb87daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.060196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e7998-c471-4bf7-b9db-81c9ea9274fe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.125901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-568e9194-9247-4683-a230-84aebb87daaa None None] MFA Rules not processed for user `f628e2323b0640b5866e3ec0d2486160`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:56.127862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-568e9194-9247-4683-a230-84aebb87daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:56.200270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.200270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.200270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.200270 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.200790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.207064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.222028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 860/1752] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:56.226009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.250215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae45f-3493-443e-b900-a34286633b94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.257354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.258463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.258950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.259328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] PATH_INFO: `/v3/projects/80b0c00085ef4b628ba9f84cb67fdfb1/users/f9a9d540c5e2480e9167f242d18ee975/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.298236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 893/1753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:56.302585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b0c00085ef4b628ba9f84cb67fdfb1, user_id=f9a9d540c5e2480e9167f242d18ee975, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.311122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9194-9247-4683-a230-84aebb87daaa None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.312575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-568e9194-9247-4683-a230-84aebb87daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:56.313453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54177e1-d2d6-4273-b275-b70c1832f455 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.337684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 861/1754] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:56 2022] PUT /identity/v3/projects/80b0c00085ef4b628ba9f84cb67fdfb1/users/f9a9d540c5e2480e9167f242d18ee975/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:21:56.348049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.349040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.349390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.391404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] MFA Rules not processed for user `f9a9d540c5e2480e9167f242d18ee975`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:56.394409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:56.407520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9194-9247-4683-a230-84aebb87daaa None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.475670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.476698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.477043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.477328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.496341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:56.503845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 862/1755] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:21:56.516831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.518960 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:56.535213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcfbce-b15f-46ea-80d7-532dd411edf2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.539952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.541136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.541504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.541874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.552260 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.553892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e749e-5a2d-4381-ac90-e91736ec199b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.566466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.568022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.578915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 894/1756] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:56.579176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 863/1757] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:21:56.604098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.701542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0b74-45e0-4951-b3be-85892be9a838 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:56.707430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:56.708075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.708357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.708666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] PATH_INFO: `/v3/users/f628e2323b0640b5866e3ec0d2486160` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.709823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f628e2323b0640b5866e3ec0d2486160)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:56.711752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:56.770768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f628e2323b0640b5866e3ec0d2486160'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:56.794423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f628e2323b0640b5866e3ec0d2486160'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:56.805224 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f628e2323b0640b5866e3ec0d2486160'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:56.813570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f628e2323b0640b5866e3ec0d2486160'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:56.814975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f628e2323b0640b5866e3ec0d2486160'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:56.821836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 895/1758] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:21:56 2022] DELETE /identity/v3/users/f628e2323b0640b5866e3ec0d2486160 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:56.828386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:56.828930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:56.829219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:56.839964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:56.862333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:56.862919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:56.980594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 864/1759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:56.991612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:56.994223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:57.103968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:57.133784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4977d-d1fc-4441-a52e-154bbc7bd09a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:57.140364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:57.141025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:57.141305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:57.141578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:57.152544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:57.154044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f994-0b71-471c-a7e4-cdfca3920d8e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:57.166025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 896/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:21:57.655300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:57.657164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:57.678627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af222c61-0dd7-49de-a9f4-fe569c22c08a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:57.685353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:57.686460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:57.686805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:57.687288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] PATH_INFO: `/v3/projects/805b89d169f2434f9dbcfc9037ef7898` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:57.689184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] RBAC: Authorizing `identity:delete_project(project_id=805b89d169f2434f9dbcfc9037ef7898)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:57.692629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:57.755028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805b89d169f2434f9dbcfc9037ef7898', 'request_id': 'req-a90e3536-f882-49b1-83d8-7cd4c87955af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:57.762595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805b89d169f2434f9dbcfc9037ef7898', 'request_id': 'req-a90e3536-f882-49b1-83d8-7cd4c87955af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:57.769612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805b89d169f2434f9dbcfc9037ef7898', 'request_id': 'req-a90e3536-f882-49b1-83d8-7cd4c87955af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:57.786935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] The token cache is being invalidate because project 805b89d169f2434f9dbcfc9037ef7898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:21:57.787512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:57.788334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a90e3536-f882-49b1-83d8-7cd4c87955af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:21:57.790659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 865/1761] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:21:57 2022] DELETE /identity/v3/projects/805b89d169f2434f9dbcfc9037ef7898 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:57.795663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:57.795957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:57.796240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:57.818634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:57.819873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:57.892336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 897/1762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:57.900702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:57.900941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:57.901190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:57.922604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:57.924344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:57.933494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 866/1763] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:57.938182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:57.949692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2dd3-8273-498e-9c89-9316cf2fe8d3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:57.956077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:57.956732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:57.957018 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:57.957328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:57.958033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:21:57.958335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:57.959934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:57.983523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 898/1764] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:21:57.988554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:57.998351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6df2-42d5-4716-b2bf-d43fc7e1c05d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.004475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.005168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.005454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.005764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.006388 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.008326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.039948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 867/1765] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:57 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:58.044265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.055736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6c7f5-6f83-447a-be98-882c28d1a41e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.121258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.121866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.122144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.122422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.123051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.124973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.148911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 899/1766] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:58 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:58.153114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.164087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847139-2b6f-451f-a2a5-09b2dbe26cf5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.169215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.169821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.170114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.170381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.171025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.172737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.184064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 868/1767] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:58.187911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.198182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9294ad-bdb6-42c1-a6ac-89d198c9b4d8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.203282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.203899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.204176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.204551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.205311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.207028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17770320-0b1f-4e84-9130-630df6d5b545 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.221938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 900/1768] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:58.223140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.233559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef43a14-6564-4ec0-b8e7-8011ea0ac445 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.240637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.241143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.241434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.241709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] PATH_INFO: `/v3/projects/41e3165c9a3e403e9818830e419e464e/users/fe9804ab55034483b35b396b60f3b334/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.261325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e3165c9a3e403e9818830e419e464e, user_id=fe9804ab55034483b35b396b60f3b334, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.264109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.277819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 869/1769] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:58 2022] PUT /identity/v3/projects/41e3165c9a3e403e9818830e419e464e/users/fe9804ab55034483b35b396b60f3b334/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:58.290625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.290928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.291197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.321712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] MFA Rules not processed for user `fe9804ab55034483b35b396b60f3b334`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:58.322921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:58.358468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:58.394108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 901/1770] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:58.398574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.432617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:58.485997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdc14-c94e-4935-be87-d289e1ddb2d2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.492836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.493444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.493773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.493997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.494771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.496727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.531466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 870/1771] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:58 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:58.536380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.552578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154986bc-95e6-4590-9cc8-327936b43ce0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.664142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.664806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.668234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.668355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.669268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.673823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.724653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 902/1772] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:58 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:58.728843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.747698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194486-b638-48d7-b0a0-0207d5e15754 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.766919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.768290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.768746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.769328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.770155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.776507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.806731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 871/1773] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:21:58.810887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.824532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba12b4-31f6-423b-8ab7-c6c675dd44d8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.836126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.838357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.838927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.839050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.839814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.842372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9894a-1637-4997-b1ca-29ac17725b61 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.887021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 903/1774] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:21:58.896556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:58.917202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5225b-4d36-40a4-80b3-c4f1eb86bc84 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:58.928295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:58.928898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:58.929384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:58.929806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] PATH_INFO: `/v3/projects/a8f8315c7f04480288d2a115b4331f3f/users/7f1788ced9544ce2a495898ddad7c90b/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:58.964889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f8315c7f04480288d2a115b4331f3f, user_id=7f1788ced9544ce2a495898ddad7c90b, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:58.969405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:58.993274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 872/1775] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:58 2022] PUT /identity/v3/projects/a8f8315c7f04480288d2a115b4331f3f/users/7f1788ced9544ce2a495898ddad7c90b/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:59.003708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.004292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.004996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.046569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] MFA Rules not processed for user `7f1788ced9544ce2a495898ddad7c90b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:59.048813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:59.179605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 904/1776] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:59.183829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.301697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c8cfa-e449-4ac4-9295-376de13463fd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.317164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.317894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.318164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.318444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.319289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.323094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.376227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 873/1777] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:21:59 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:59.378136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.388749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ade3f-0510-45f5-abd6-2c0b544c9d58 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.430983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:59.449617 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.450402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.450726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.451022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.451761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.453719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.474441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 905/1778] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:21:59 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:21:59.478261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.491442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c06e-0708-415d-b2d5-f3110df6bdc3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.497708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.498336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.498617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.498892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.500303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.502996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.514550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 874/1779] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:59.518841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.530952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350923-e030-43bf-8c15-a99121d87327 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.536051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.536773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.537058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.537331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] PATH_INFO: `/v3/projects/0d02af0c99c143f79498b30cec9e8929/users/cab4ea599aa747a098921d7907a39164/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.553428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d02af0c99c143f79498b30cec9e8929, user_id=cab4ea599aa747a098921d7907a39164, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.556428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.571890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 906/1780] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:59 2022] PUT /identity/v3/projects/0d02af0c99c143f79498b30cec9e8929/users/cab4ea599aa747a098921d7907a39164/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:59.576018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.586969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e35077-73b4-4fac-91b4-51e3af48a3d1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.638945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:59.653404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.654264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.654550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.654826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.657165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.658861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcfe75-5c9b-48b9-b8ea-514e9991db23 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.673028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 875/1781] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:21:59.674368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.691956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727fd69-2b46-4daf-bb44-d11ebfe05944 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.700237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.701712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.702128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.702600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] PATH_INFO: `/v3/projects/0d02af0c99c143f79498b30cec9e8929/users/cab4ea599aa747a098921d7907a39164/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.705525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d02af0c99c143f79498b30cec9e8929, user_id=cab4ea599aa747a098921d7907a39164, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:21:59.709025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:21:59.722576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 907/1782] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:21:59 2022] PUT /identity/v3/projects/0d02af0c99c143f79498b30cec9e8929/users/cab4ea599aa747a098921d7907a39164/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:21:59.732882 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.733170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.733445 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:21:59.762726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] MFA Rules not processed for user `cab4ea599aa747a098921d7907a39164`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:21:59.764092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:59.841013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 876/1783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:21:59.853392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:21:59.855897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:21:59.935010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d3abf-125d-428f-9501-b8a3e3123379 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:21:59.939988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:21:59.940627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:21:59.940970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:21:59.941249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.016424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:00.018564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.019835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:00.021313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828c80e-dc34-46f0-bb66-8bbb667bcc87 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:00.031246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 908/1784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:21:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:00.096177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0ce4-1905-4d3d-b78f-cc5d9c6bcad7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:00.100954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:00.101594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.101899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.102174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] PATH_INFO: `/v3/users/f9a9d540c5e2480e9167f242d18ee975` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.103319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a9d540c5e2480e9167f242d18ee975)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:00.105342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:00.159681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a9d540c5e2480e9167f242d18ee975'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.167959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a9d540c5e2480e9167f242d18ee975'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.181774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:00.182962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a9d540c5e2480e9167f242d18ee975'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.184275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a9d540c5e2480e9167f242d18ee975'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.194194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a9d540c5e2480e9167f242d18ee975'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.202849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 877/1785] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:00 2022] DELETE /identity/v3/users/f9a9d540c5e2480e9167f242d18ee975 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:00.208093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.208587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.208977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.231371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:00.233108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.287748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:00.306529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 909/1786] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:00.318587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:00.320161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.413949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a399-3546-4dfd-bfab-e50136b78b04 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:00.417883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:00.418567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.418850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.419128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.429347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:00.430783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:00.440371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 878/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:00.713186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:00.714611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.738379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9d80-7f1a-4343-855b-c2b1800f4eef None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:00.743498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:00.744176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.744497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.744763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] PATH_INFO: `/v3/projects/80b0c00085ef4b628ba9f84cb67fdfb1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.745455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:00.745896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b0c00085ef4b628ba9f84cb67fdfb1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:00.746869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.747804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:00.760350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b145c-dfc9-48ad-9637-6a104f076615 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:00.766465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:00.767098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.767441 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.767714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] PATH_INFO: `/v3/users/0cb4349fd92249c2ab72065b16be5ea6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.768878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb4349fd92249c2ab72065b16be5ea6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:00.770929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:00.821075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b0c00085ef4b628ba9f84cb67fdfb1', 'request_id': 'req-02601e15-7b8f-4543-9038-4975e73cfc4e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.830291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb4349fd92249c2ab72065b16be5ea6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.830512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b0c00085ef4b628ba9f84cb67fdfb1', 'request_id': 'req-02601e15-7b8f-4543-9038-4975e73cfc4e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.838163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb4349fd92249c2ab72065b16be5ea6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.838331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b0c00085ef4b628ba9f84cb67fdfb1', 'request_id': 'req-02601e15-7b8f-4543-9038-4975e73cfc4e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.852988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb4349fd92249c2ab72065b16be5ea6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.853946 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb4349fd92249c2ab72065b16be5ea6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.854808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] The token cache is being invalidate because project 80b0c00085ef4b628ba9f84cb67fdfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:00.855221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.856136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-02601e15-7b8f-4543-9038-4975e73cfc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.858203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 910/1788] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:00 2022] DELETE /identity/v3/projects/80b0c00085ef4b628ba9f84cb67fdfb1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:00.864247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde633d-79f6-4769-ad66-581dfb6e5d3f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.864665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde633d-79f6-4769-ad66-581dfb6e5d3f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.864995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde633d-79f6-4769-ad66-581dfb6e5d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.865313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6099dc4d-737c-4005-92ba-34c08df490fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb4349fd92249c2ab72065b16be5ea6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:00.874269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 879/1789] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:00 2022] DELETE /identity/v3/users/0cb4349fd92249c2ab72065b16be5ea6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:00.879246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.879624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.879988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.892188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8cde633d-79f6-4769-ad66-581dfb6e5d3f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:00.893459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8cde633d-79f6-4769-ad66-581dfb6e5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.901285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:00.902464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.957159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 911/1790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:00.965146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 880/1791] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:00.966581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:00.966872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:00.967178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:00.974565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:00.975922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.982071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:00.988896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:00.990043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:00.998793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 912/1792] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:01.003634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.013515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909350d-7cea-46b8-8dfe-181c51b515f2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.018288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.018884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.019164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.019438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.020096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:01.020381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.022004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.033758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 913/1793] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:22:01.036342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb0df-1208-42c5-b225-ebcff00f70a0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.038267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.040041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.040948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.041229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.041502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.048316 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862c94-f2fb-41ed-8bdb-ce97677ce5fd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.051539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.053011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.053488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.054074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.054358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.054632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.055251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.057197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.062598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 881/1794] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:22:01.087186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 914/1795] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:01.091582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.102583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b0dd-3a87-4501-8d66-bdd8e4e21e67 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.174825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.175878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.176403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.176705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.179295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.181498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.212656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 882/1796] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:01 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:01.216825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.230652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84531f1-b0fa-467c-82ea-c1931e1e206e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.235696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.236366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.236688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.236982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.237682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.245312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.264773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 915/1797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:01.265436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.278647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c828ac-e815-431e-a373-a9b476f1755d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.287356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.288213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.288745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.289164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.290586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.292712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.318066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.334218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 883/1798] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:01.338519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf6de-3601-46b0-b6d1-5fff0504bd7f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.343878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.345053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.345053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.345284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] PATH_INFO: `/v3/projects/8ec017f2022a4685be902af8a2908760/users/0a6f69f4cb4f4208bf97967b1d40b448/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.393978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec017f2022a4685be902af8a2908760, user_id=0a6f69f4cb4f4208bf97967b1d40b448, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.397315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109549fa-0d78-4fb4-8738-98923c7ae7bc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.435085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:01.448239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.452132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:01.475815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 916/1799] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:01 2022] PUT /identity/v3/projects/8ec017f2022a4685be902af8a2908760/users/0a6f69f4cb4f4208bf97967b1d40b448/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:01.477370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.477661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.479343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.487864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f0c83-c957-4a7b-acde-4f17da1460ac admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.537428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] MFA Rules not processed for user `0a6f69f4cb4f4208bf97967b1d40b448`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:01.538814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:01.618589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.619238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.619643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.619786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] PATH_INFO: `/v3/projects/50467d21a4824fcaab7e98beb90fae71` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.623103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50467d21a4824fcaab7e98beb90fae71)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.625255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.704689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 917/1800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:01.707355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.713030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:01.725858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c103-84cb-4738-962f-227a7df08c0e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.758768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50467d21a4824fcaab7e98beb90fae71', 'request_id': 'req-d9572aaa-9ea0-4770-9ee0-67a0baee180f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:01.769456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50467d21a4824fcaab7e98beb90fae71', 'request_id': 'req-d9572aaa-9ea0-4770-9ee0-67a0baee180f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:01.788570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50467d21a4824fcaab7e98beb90fae71', 'request_id': 'req-d9572aaa-9ea0-4770-9ee0-67a0baee180f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:01.805329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] The token cache is being invalidate because project 50467d21a4824fcaab7e98beb90fae71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:01.805758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:01.810487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:01.811755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 884/1801] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:01 2022] DELETE /identity/v3/projects/50467d21a4824fcaab7e98beb90fae71 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:01.816044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.817473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:01.835514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.836243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.836626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.836973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.837676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.839634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.867454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 918/1802] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:01.868565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:01.870145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:01.887448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572aaa-9ea0-4770-9ee0-67a0baee180f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.929629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e5b9b-3165-4af2-985d-0418c261442d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:01.933199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.933802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.934090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.934364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.936077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:01.944887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:01.945522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:01.945802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:01.946075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] PATH_INFO: `/v3/users/748395587ddb42d7b8322b9e4b356b29` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:01.947197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748395587ddb42d7b8322b9e4b356b29)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:01.949150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:01.964039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:02.000508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748395587ddb42d7b8322b9e4b356b29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.000689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.002083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.009253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748395587ddb42d7b8322b9e4b356b29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.010833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 919/1803] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:02.011608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.012996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.018692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:02.025454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748395587ddb42d7b8322b9e4b356b29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.026682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748395587ddb42d7b8322b9e4b356b29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.027716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2426cb9-736b-401c-9a69-b15b0f62c36b service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.034521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.035134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.035526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.035832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.036641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.037800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748395587ddb42d7b8322b9e4b356b29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.038559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.045595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 885/1804] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:01 2022] DELETE /identity/v3/users/748395587ddb42d7b8322b9e4b356b29 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:02.070164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 920/1805] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:02.074121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.076215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.152189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799046-fa5c-4ec8-9146-5c28cd5e1c47 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.158809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.160005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.160297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.160730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.161264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.162978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.176374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 886/1806] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:02.180158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.191054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d522-6052-4f9b-bd29-079778d85b86 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.196183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.196418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.196781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.197060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.197705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.199344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc931e-802f-47e3-8794-52724db98fbb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.211838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 921/1807] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:02.215860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.229811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f67d23-8fed-4b76-88fa-b17f3a201cf3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.234877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.235539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.236512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.237185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] PATH_INFO: `/v3/projects/da052f8e2c584af9a5e6ea285bd46954/users/2222ac1160bc4270952a857efbd9fc9b/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.254202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052f8e2c584af9a5e6ea285bd46954, user_id=2222ac1160bc4270952a857efbd9fc9b, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.257584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.280073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 887/1808] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:02 2022] PUT /identity/v3/projects/da052f8e2c584af9a5e6ea285bd46954/users/2222ac1160bc4270952a857efbd9fc9b/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:02.283359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.283833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.284137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.319460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] MFA Rules not processed for user `2222ac1160bc4270952a857efbd9fc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:02.320876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.358303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.360196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.419937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 922/1809] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:02.424610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.474626 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2a4f-fb45-4747-b642-f19b4f1bf145 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.480476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.485396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.485743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.493101 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] PATH_INFO: `/v3/projects/0ba02e52fdee4ce88870841193a47d40` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.495079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba02e52fdee4ce88870841193a47d40)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.497207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.530080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbccf9-1712-4b1c-94d9-e38089c4a167 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.535961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.536648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.536939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.537214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.537906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.539881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.581192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 923/1810] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:02.585340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.590309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba02e52fdee4ce88870841193a47d40', 'request_id': 'req-4ed7d860-8e87-4b0d-9262-0055d565c91a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.600487 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba02e52fdee4ce88870841193a47d40', 'request_id': 'req-4ed7d860-8e87-4b0d-9262-0055d565c91a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.602043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:02.604872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:02.612100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba02e52fdee4ce88870841193a47d40', 'request_id': 'req-4ed7d860-8e87-4b0d-9262-0055d565c91a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.640661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] The token cache is being invalidate because project 0ba02e52fdee4ce88870841193a47d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:02.641044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.642994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4ed7d860-8e87-4b0d-9262-0055d565c91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:02.648962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 888/1811] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:02 2022] DELETE /identity/v3/projects/0ba02e52fdee4ce88870841193a47d40 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:02.652496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496bf-5c3f-4b07-acb9-eb4f2483484b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.653856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496bf-5c3f-4b07-acb9-eb4f2483484b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.654149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c496bf-5c3f-4b07-acb9-eb4f2483484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.683792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa6ebf-562d-4bb1-947e-2d5e65d0bfe7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.691636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f2c496bf-5c3f-4b07-acb9-eb4f2483484b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:02.691756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.691875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f2c496bf-5c3f-4b07-acb9-eb4f2483484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.691969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.691969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.691969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.691969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.691969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.698497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 889/1812] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:02.709161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.709511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.709897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.739550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 924/1813] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:02.739702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:02.739794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.739876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.741314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.754293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 890/1814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:02.755206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.757379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.778844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55b1e5-3074-4c91-b062-e3391fbf3cbc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.778844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.778844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.779204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.779204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.779867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.781517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.793744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 891/1815] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:02.794712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.810425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d07e-c626-4c98-9ece-94a2b85b1fee admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.818249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.819581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.820052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.820375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.821077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:02.821416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.823876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.838429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3ba4a-21c9-42bf-ba2f-a7c785227698 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.840289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 892/1816] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:02.841168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.848114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.849938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.850350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.850806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.852747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:02.855319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9fe0f-9295-4073-a25e-250ed68239b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:02.861016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:02.862005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:02.862692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:02.863202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] PATH_INFO: `/v3/projects/5d1c735f9db740b6a76f269270da2af0/users/823ea74255b542a581fc4446b6f76509/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:02.884484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c735f9db740b6a76f269270da2af0, user_id=823ea74255b542a581fc4446b6f76509, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.887421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.906225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 893/1817] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:02 2022] PUT /identity/v3/projects/5d1c735f9db740b6a76f269270da2af0/users/823ea74255b542a581fc4446b6f76509/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:02.907339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.949137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:02.951251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:02.968859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 925/1818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:02.969749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:02.985571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c755-f321-49f9-86fe-ae1e88cf0fdc service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.031791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0f1e-5c2b-4cb0-9a63-ca64b3377f45 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.041354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.042032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.042241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.042523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.043408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.045103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.052156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:03.068029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.068729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.069016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.069476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.070169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.071922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.083698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 926/1819] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:03.087923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.090123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 894/1820] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:02 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:03.095341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.105813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca388df-3398-4f71-8819-720c79858a0a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.173990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.174719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.175000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.175319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] PATH_INFO: `/v3/projects/5d1c735f9db740b6a76f269270da2af0/users/823ea74255b542a581fc4446b6f76509/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.177278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1c735f9db740b6a76f269270da2af0, user_id=823ea74255b542a581fc4446b6f76509, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.178309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e830d-d10a-4d6f-96f4-0414a8859e46 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.179936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61800c-5445-4ac0-93f2-15649cd2971b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.184096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.184883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.185236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.185511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.186328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.188237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.191276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 927/1821] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:03 2022] PUT /identity/v3/projects/5d1c735f9db740b6a76f269270da2af0/users/823ea74255b542a581fc4446b6f76509/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:03.202787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.203100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.203411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.206928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:03.213835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 895/1822] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:03 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:03.217888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.232620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380c314-4ee4-4c91-819c-2811b840a947 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.238311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] MFA Rules not processed for user `823ea74255b542a581fc4446b6f76509`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:03.239517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:03.295680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.296381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.296717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.297000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.297836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.300080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.311426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 896/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:03.315360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 928/1824] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:03.316084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.326111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72186a-936e-4907-9488-43c0e3d63989 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.326669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.331603 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.332203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.332503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.333039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.333682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.335249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.348367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 897/1825] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:03.352943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.366015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89a4c-43a3-48a2-a042-0b35c1b8d03d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.373472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.374141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.374420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.374718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] PATH_INFO: `/v3/projects/95edaed07ea641188db40ada3af11caa/users/333944823ac7410cb4c96497d6cf7999/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.388962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52ac5-acbc-41dd-a8d2-ff5050416034 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.391568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95edaed07ea641188db40ada3af11caa, user_id=333944823ac7410cb4c96497d6cf7999, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.393170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.393823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.394099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.394390 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.395958 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299cab9-4556-43b4-8244-e3f1f73fb366 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.396611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:03.410837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 898/1826] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:03 2022] PUT /identity/v3/projects/95edaed07ea641188db40ada3af11caa/users/333944823ac7410cb4c96497d6cf7999/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:03.422052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:03.423983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.424378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.424687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.458566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] MFA Rules not processed for user `333944823ac7410cb4c96497d6cf7999`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:03.460028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:03.472189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.474534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.486287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 929/1827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:22:03.533398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 899/1828] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:03.545241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:03.546687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:03.557837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8818-5b70-482b-83f8-fb99fbd0a3e4 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:03.622893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:03.623800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:03.624079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:03.624394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:03.638274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:03.640499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:03.652360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 930/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:05.224538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:05.234621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c66137-5f61-435f-9e9f-7267036f7f5a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:05.238302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:05.238914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:05.239197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:05.239473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:05.241573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:05.300156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:05.317248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:05.317784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:05.340009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 900/1830] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:06.030101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:06.045185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463759a5-cf6d-4601-82be-378f290a604b service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:06.050694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:06.050694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:06.050694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:06.051221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:06.135197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:06.136887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04420e-52e1-4c3a-9a12-a7edd765927b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:06.157079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 931/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:07.379641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:07.381221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:07.453964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4908f0-d17b-4ad6-a5bf-e3c1998124c9 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:07.459691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:07.460413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:07.460799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:07.461083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] PATH_INFO: `/v3/users/fe9804ab55034483b35b396b60f3b334` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:07.462208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9804ab55034483b35b396b60f3b334)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:07.464141 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:07.517873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9804ab55034483b35b396b60f3b334'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:07.528519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9804ab55034483b35b396b60f3b334'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:07.553251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9804ab55034483b35b396b60f3b334'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:07.554311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9804ab55034483b35b396b60f3b334'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:07.568795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9804ab55034483b35b396b60f3b334'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:07.580213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 901/1832] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:07 2022] DELETE /identity/v3/users/fe9804ab55034483b35b396b60f3b334 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:07.582322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:07.582884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:07.582990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:07.628768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:07.628768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:07.747130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:07.761743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 932/1833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:07.785103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:07.793850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:07.894746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4136b-7559-4bb4-9f80-115cb953a60e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:07.898343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:07.898949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:07.899230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:07.899501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:07.909664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:07.911133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:07.921108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 902/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:08.209943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:08.211362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:08.227663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee3c61-7eeb-4cff-ac65-42cfc5a9ebfe None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:08.233411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:08.234747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:08.235038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:08.235487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] PATH_INFO: `/v3/projects/41e3165c9a3e403e9818830e419e464e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:08.237358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e3165c9a3e403e9818830e419e464e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:08.239360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:08.288912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e3165c9a3e403e9818830e419e464e', 'request_id': 'req-a299d9ec-7b9c-4164-95eb-ab3a10240427'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.296692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e3165c9a3e403e9818830e419e464e', 'request_id': 'req-a299d9ec-7b9c-4164-95eb-ab3a10240427'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.304436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e3165c9a3e403e9818830e419e464e', 'request_id': 'req-a299d9ec-7b9c-4164-95eb-ab3a10240427'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.315927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] The token cache is being invalidate because project 41e3165c9a3e403e9818830e419e464e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:08.316211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.316866 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.318340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 933/1835] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:08 2022] DELETE /identity/v3/projects/41e3165c9a3e403e9818830e419e464e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:08.322582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:08.332990 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b45fd-9e94-412a-bdf1-773ffbd9b496 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:08.338233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:08.405685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:08.406555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:08.406843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:08.407118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] PATH_INFO: `/v3/users/7f1788ced9544ce2a495898ddad7c90b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:08.409229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1788ced9544ce2a495898ddad7c90b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:08.411367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:08.467724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1788ced9544ce2a495898ddad7c90b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.477354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1788ced9544ce2a495898ddad7c90b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.490962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1788ced9544ce2a495898ddad7c90b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.491687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1788ced9544ce2a495898ddad7c90b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.500078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1788ced9544ce2a495898ddad7c90b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:08.508175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 903/1836] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:08 2022] DELETE /identity/v3/users/7f1788ced9544ce2a495898ddad7c90b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:08.836499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:08.839978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:08.884223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299d9ec-7b9c-4164-95eb-ab3a10240427 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:08.910908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:08.912434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:09.035402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:09.036149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:09.036843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:09.037875 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] PATH_INFO: `/v3/projects/a8f8315c7f04480288d2a115b4331f3f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:09.039374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f8315c7f04480288d2a115b4331f3f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:09.042256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:09.088755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244d9c-9de2-48ce-90ad-5a036a5d448c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:09.111271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:09.112134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:09.112424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:09.112729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] PATH_INFO: `/v3/users/333944823ac7410cb4c96497d6cf7999` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:09.113970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=333944823ac7410cb4c96497d6cf7999)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:09.115924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:09.194859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f8315c7f04480288d2a115b4331f3f', 'request_id': 'req-aa8a4804-c28f-4725-941f-8d0099b30e29'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.203764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:09.231609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f8315c7f04480288d2a115b4331f3f', 'request_id': 'req-aa8a4804-c28f-4725-941f-8d0099b30e29'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.247058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f8315c7f04480288d2a115b4331f3f', 'request_id': 'req-aa8a4804-c28f-4725-941f-8d0099b30e29'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.248674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333944823ac7410cb4c96497d6cf7999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.261701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333944823ac7410cb4c96497d6cf7999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.265444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] The token cache is being invalidate because project a8f8315c7f04480288d2a115b4331f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:09.265444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.266373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.270228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 934/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:08 2022] DELETE /identity/v3/projects/a8f8315c7f04480288d2a115b4331f3f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:09.274242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:09.275659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:09.283924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333944823ac7410cb4c96497d6cf7999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.284889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333944823ac7410cb4c96497d6cf7999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.292364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:09.309024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c57ff15a-295e-4429-bd1f-1f53f829a98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333944823ac7410cb4c96497d6cf7999'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.324499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 904/1838] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:08 2022] DELETE /identity/v3/users/333944823ac7410cb4c96497d6cf7999 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:09.326653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:09.326948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:09.327223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:09.356575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:09.358563 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:09.369609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a4804-c28f-4725-941f-8d0099b30e29 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:09.434166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 905/1839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:09.436837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:09.437626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:09.437915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:09.438165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] PATH_INFO: `/v3/users/cab4ea599aa747a098921d7907a39164` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:09.439403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab4ea599aa747a098921d7907a39164)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:09.441586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:09.445925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:09.448489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:09.506801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab4ea599aa747a098921d7907a39164'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.524484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab4ea599aa747a098921d7907a39164'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.531479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bb06-df17-4045-890a-ce14179f04e8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:09.534689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab4ea599aa747a098921d7907a39164'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.536377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:09.537029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:09.537308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:09.537730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:09.545466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab4ea599aa747a098921d7907a39164'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.546109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab4ea599aa747a098921d7907a39164'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:09.549703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:09.551211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:09.554900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 935/1840] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:09 2022] DELETE /identity/v3/users/cab4ea599aa747a098921d7907a39164 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:09.562586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 906/1841] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:09.953528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:09.955835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.010196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:10.039676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d66f3-d0f8-4a0b-a811-5a49f73eaa2d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.047730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.048005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.049734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.050107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] PATH_INFO: `/v3/projects/0d02af0c99c143f79498b30cec9e8929` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.051459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d02af0c99c143f79498b30cec9e8929)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.053661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.076851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.078495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.105889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d2b12-fb3a-41e4-8efa-47eb312033f9 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.120116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.120807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.121092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.121370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] PATH_INFO: `/v3/projects/95edaed07ea641188db40ada3af11caa` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.123548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95edaed07ea641188db40ada3af11caa)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.125529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.160133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d02af0c99c143f79498b30cec9e8929', 'request_id': 'req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.169396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d02af0c99c143f79498b30cec9e8929', 'request_id': 'req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.178215 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d02af0c99c143f79498b30cec9e8929', 'request_id': 'req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.192630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] The token cache is being invalidate because project 0d02af0c99c143f79498b30cec9e8929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:10.193099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.193757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d869cd2-4b0d-4435-a79c-6d8b5b68fed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.195577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 936/1842] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:09 2022] DELETE /identity/v3/projects/0d02af0c99c143f79498b30cec9e8929 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:10.197323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5dea-81e1-4ea6-8bf4-0019b61be05a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.197895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5dea-81e1-4ea6-8bf4-0019b61be05a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.198177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5dea-81e1-4ea6-8bf4-0019b61be05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.203749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:10.209312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95edaed07ea641188db40ada3af11caa', 'request_id': 'req-ce88aa42-356a-481d-9d13-42ac636d973b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.222558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95edaed07ea641188db40ada3af11caa', 'request_id': 'req-ce88aa42-356a-481d-9d13-42ac636d973b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.228980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b33a5dea-81e1-4ea6-8bf4-0019b61be05a None None] MFA Rules not processed for user `d1f15f28bba84ac89fd9902dfe168468`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.229115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95edaed07ea641188db40ada3af11caa', 'request_id': 'req-ce88aa42-356a-481d-9d13-42ac636d973b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.230625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b33a5dea-81e1-4ea6-8bf4-0019b61be05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.243461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] The token cache is being invalidate because project 95edaed07ea641188db40ada3af11caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:10.243807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.244712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce88aa42-356a-481d-9d13-42ac636d973b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.250104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 907/1843] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:10 2022] DELETE /identity/v3/projects/95edaed07ea641188db40ada3af11caa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:10.252166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86208f3-75bd-4146-8f92-e5bd30efba32 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.252653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86208f3-75bd-4146-8f92-e5bd30efba32 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.252883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86208f3-75bd-4146-8f92-e5bd30efba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.274612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d86208f3-75bd-4146-8f92-e5bd30efba32 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.275813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d86208f3-75bd-4146-8f92-e5bd30efba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.294683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 937/1844] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:10.296128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355556-41cf-497c-be0f-c79ce1c9d5f9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.296545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355556-41cf-497c-be0f-c79ce1c9d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.296985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355556-41cf-497c-be0f-c79ce1c9d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.318705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9e355556-41cf-497c-be0f-c79ce1c9d5f9 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.319923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9e355556-41cf-497c-be0f-c79ce1c9d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.385529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 908/1845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:10.428237 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 938/1846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:10.438378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.440549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.440881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.455429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.455766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.456091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.470029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.472878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.478044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.479408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.493510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 909/1847] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:10.493621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 939/1848] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:10.496234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.496768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.507211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa942-2d68-4a67-b9f1-e03b510a2481 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.507391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d6743-f3f8-4dfc-9816-ed178570f11b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.513058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.513485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.514333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.514818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.514994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.515254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.515535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.515903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.516359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:10.517566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:10.517769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.518330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.519358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.520492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.523905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:10.539263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 910/1849] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:10.541469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.543489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.544824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 940/1850] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:10.545720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.565683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997752-36bd-47b7-adda-224be3f919a9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.567834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b85a-305c-48ef-8f3e-78e66f8ba7d5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.579426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.581078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.581371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.581652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.582301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.584444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.586192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.586852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.587182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.587403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] PATH_INFO: `/v3/users/0a6f69f4cb4f4208bf97967b1d40b448` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.588641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6f69f4cb4f4208bf97967b1d40b448)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.590606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.630246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 941/1851] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:10.631186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.658015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6f69f4cb4f4208bf97967b1d40b448'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.666473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6f69f4cb4f4208bf97967b1d40b448'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.682488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6f69f4cb4f4208bf97967b1d40b448'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.683446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6f69f4cb4f4208bf97967b1d40b448'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.694259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6f69f4cb4f4208bf97967b1d40b448'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:10.702155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 911/1852] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:10 2022] DELETE /identity/v3/users/0a6f69f4cb4f4208bf97967b1d40b448 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:10.703148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.705276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.748923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ff435-3dad-4dcf-92b2-74cdfd87ed5b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.749278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:10.809132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a9cf9-5a6a-40a6-bfc9-c22178df0e94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.815600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.816299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.816735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.817012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.817653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.819646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe61b-c9cd-4c6d-b780-e8ef714fcbd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.831188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.832757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.833188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.833424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.834584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.837267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.842829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 912/1853] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:10.844170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.844486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.844753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.868090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:10.869321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.880621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 913/1854] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:10.880621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.887403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 942/1855] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:10.891242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.894490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.894905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7b52-6bcf-4a09-849f-b56b410ca260 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.959222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.959863 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.960144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.960406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.961097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.962895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:10.980003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 914/1856] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:10.980003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:10.980003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:10.988254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f6b1-706a-4883-8382-c45b37415820 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:10.995255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:10.996040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:10.996518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:10.996785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:10.997498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:10.999939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.020800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:11.036411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 943/1857] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:10 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:11.037610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.052284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8571f-1da1-4e11-90c1-3bdfb1f6a1a3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.057680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.058306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.058593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.059172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.059984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.062173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.063409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0a01c-58b9-4048-b063-3bf4eb6e33f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.068702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.069617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.070041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.070621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.081800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 944/1858] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:11.081800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.089450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.090945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.097488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766d22f-9fb7-4756-bd95-f3271efac87e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.102513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.103233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 915/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:11.103352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.103815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.104105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.104625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.104851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.106472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.117071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36450ed7-9ccb-44d0-8d2b-93a965491ee4 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.122485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 945/1860] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:11.123413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.123649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.124782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.125308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.125850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] PATH_INFO: `/v3/projects/5d99560318b345c382eeb1c655dd2b46/users/e88267da8a264feaa12e6cc41153e5c8/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.136931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3308-0e84-4266-ac66-c9d24f6e4c34 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.146207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.146853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.147110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.147800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.148504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.150432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.157937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d99560318b345c382eeb1c655dd2b46, user_id=e88267da8a264feaa12e6cc41153e5c8, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.163872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da9b55-ce63-4a9c-a066-010562b9ebb4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.167728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 946/1861] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:11.172886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.190750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 916/1862] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:11 2022] PUT /identity/v3/projects/5d99560318b345c382eeb1c655dd2b46/users/e88267da8a264feaa12e6cc41153e5c8/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:11.194921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab66b3-3dc4-47a5-8eca-757c67dbde46 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.203408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.203708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.203966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.245083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] MFA Rules not processed for user `e88267da8a264feaa12e6cc41153e5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:11.246448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:11.276765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:11.288129 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.289094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.290973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.291407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] PATH_INFO: `/v3/projects/408aa96a5b2f409dba8bd3f37b14d12a/users/97ef071a7fcb4ac397be8a332cd7eddf/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.321259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408aa96a5b2f409dba8bd3f37b14d12a, user_id=97ef071a7fcb4ac397be8a332cd7eddf, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.324540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf55d6-a7f6-4bd5-9578-8a8e8a76e5d0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.345880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 947/1863] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:11 2022] PUT /identity/v3/projects/408aa96a5b2f409dba8bd3f37b14d12a/users/97ef071a7fcb4ac397be8a332cd7eddf/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:11.347523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.348816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.349102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.353034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 917/1864] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:11.362785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.365095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:11.408047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:11.410183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:11.488037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b5c7-9da3-488a-becd-f72bda15bfa4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.503928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 948/1865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:11.510731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.563697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.565061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.565351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.565658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.601152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:11.607796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f361c7-121b-433c-ba85-ce1d2f81f88c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.612548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.613177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.613464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.613804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.623907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.625355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.634040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.635713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.636885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 949/1866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:22:11.637905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.639491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:11.651736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 918/1867] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:22:11.654937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3485cd3-5431-4a5d-b15c-8f82a56909f9 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.660000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.660667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.661044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.661227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] PATH_INFO: `/v3/projects/8ec017f2022a4685be902af8a2908760` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.662480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec017f2022a4685be902af8a2908760)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.664774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:11.759213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec017f2022a4685be902af8a2908760', 'request_id': 'req-a84c067a-0996-4fe1-8371-b5d361c5f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:11.769879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec017f2022a4685be902af8a2908760', 'request_id': 'req-a84c067a-0996-4fe1-8371-b5d361c5f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:11.779810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec017f2022a4685be902af8a2908760', 'request_id': 'req-a84c067a-0996-4fe1-8371-b5d361c5f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:11.794764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] The token cache is being invalidate because project 8ec017f2022a4685be902af8a2908760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:11.795054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:11.796004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:11.797908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 950/1868] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:11 2022] DELETE /identity/v3/projects/8ec017f2022a4685be902af8a2908760 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:11.803139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:11.817440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c19e-0003-4e85-823b-7180737df01f service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:11.907481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:11.968532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:11.970808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:11.971249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:11.971502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] PATH_INFO: `/v3/users/2222ac1160bc4270952a857efbd9fc9b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:11.978798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2222ac1160bc4270952a857efbd9fc9b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:11.981504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:12.058155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2222ac1160bc4270952a857efbd9fc9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:12.072704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2222ac1160bc4270952a857efbd9fc9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:12.108697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2222ac1160bc4270952a857efbd9fc9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:12.112281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2222ac1160bc4270952a857efbd9fc9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:12.139665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2222ac1160bc4270952a857efbd9fc9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:12.169480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 919/1869] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:11 2022] DELETE /identity/v3/users/2222ac1160bc4270952a857efbd9fc9b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:13.189772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:13.193486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:13.212697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c067a-0996-4fe1-8371-b5d361c5f140 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:13.320287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:13.320900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:13.321611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:13.321611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] PATH_INFO: `/v3/projects/da052f8e2c584af9a5e6ea285bd46954` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:13.324407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da052f8e2c584af9a5e6ea285bd46954)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:13.329102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:13.399077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da052f8e2c584af9a5e6ea285bd46954', 'request_id': 'req-60a419ff-cd11-4c42-b134-fe7dad38fe7c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.421205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da052f8e2c584af9a5e6ea285bd46954', 'request_id': 'req-60a419ff-cd11-4c42-b134-fe7dad38fe7c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.421205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da052f8e2c584af9a5e6ea285bd46954', 'request_id': 'req-60a419ff-cd11-4c42-b134-fe7dad38fe7c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.432998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] The token cache is being invalidate because project da052f8e2c584af9a5e6ea285bd46954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:13.433462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.434815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.437802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 951/1870] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:13 2022] DELETE /identity/v3/projects/da052f8e2c584af9a5e6ea285bd46954 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:13.442653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:13.444690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:13.478895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d3c0-e50a-4307-902f-a2e5d0f3ce76 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:13.610264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:13.611189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:13.611674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:13.611953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] PATH_INFO: `/v3/users/823ea74255b542a581fc4446b6f76509` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:13.613456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] RBAC: Authorizing `identity:delete_user(user_id=823ea74255b542a581fc4446b6f76509)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:13.617539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:13.721621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:13.724215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823ea74255b542a581fc4446b6f76509'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.736894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823ea74255b542a581fc4446b6f76509'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.751235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823ea74255b542a581fc4446b6f76509'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.751977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823ea74255b542a581fc4446b6f76509'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.763420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-85617ee8-47f1-428c-bb7f-3c25d01c446f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823ea74255b542a581fc4446b6f76509'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:13.809306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 920/1871] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:13 2022] DELETE /identity/v3/users/823ea74255b542a581fc4446b6f76509 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:15.099741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:15.101779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:15.111441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:15.127763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a419ff-cd11-4c42-b134-fe7dad38fe7c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:15.281029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:15.284758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:15.285066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:15.285350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] PATH_INFO: `/v3/projects/5d1c735f9db740b6a76f269270da2af0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:15.288068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1c735f9db740b6a76f269270da2af0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:15.290329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:15.422403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1c735f9db740b6a76f269270da2af0', 'request_id': 'req-0ab6139a-5431-498a-a5a1-4c5cca01700c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:15.440649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1c735f9db740b6a76f269270da2af0', 'request_id': 'req-0ab6139a-5431-498a-a5a1-4c5cca01700c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:15.455019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1c735f9db740b6a76f269270da2af0', 'request_id': 'req-0ab6139a-5431-498a-a5a1-4c5cca01700c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:15.477988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] The token cache is being invalidate because project 5d1c735f9db740b6a76f269270da2af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:15.478429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:15.480735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0ab6139a-5431-498a-a5a1-4c5cca01700c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:15.486808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 952/1872] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:15 2022] DELETE /identity/v3/projects/5d1c735f9db740b6a76f269270da2af0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:15.491981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:15.492534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:15.492915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:15.566341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:15.573002 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:15.724146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 921/1873] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:15.731572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:15.732571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:15.733072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:15.764297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:15.765972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:15.785932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 953/1874] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:15.790681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:15.808054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6740-ed75-4ee6-b9b2-be0668447369 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:15.825361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:15.826008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:15.826288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:15.826599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:15.827573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:15.827881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:15.830781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:15.848533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 922/1875] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:15.850788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:15.865690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb46a-bd5b-4c9e-8014-4cb823f4f520 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:15.871085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:15.872671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:15.873055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:15.873724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:15.874654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:15.878542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:15.922596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 954/1876] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:15 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:15.929059 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:15.942301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959bd43-2c53-44f4-a5c9-6fa769d31d8d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:16.101243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:16.102154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.102616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.102897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.103539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:16.105524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:16.152153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 923/1877] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:15 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:16.156954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:16.190405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9262c-d23d-48b8-906e-02ccf921d57f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:16.211733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:16.213165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.215644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.217310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.218131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:16.220387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:16.261346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 955/1878] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:16.264781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:16.286468 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933bb8c-a02b-40dc-abe5-8979be6d2d55 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:16.307493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:16.308380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.308380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.313878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.315220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:16.317504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ad90e-519b-455a-9561-db543293e11c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:16.334788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 924/1879] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:16.336059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:16.348634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b92b73-7b7f-4471-b94b-ad9d3b212384 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:16.358353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:16.358853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.359251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.359622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] PATH_INFO: `/v3/projects/e0dc7b0285d1473894d72580989c54d1/users/cb31b65a4e684a7bbb228b7986e2a8d0/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.380989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dc7b0285d1473894d72580989c54d1, user_id=cb31b65a4e684a7bbb228b7986e2a8d0, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:16.384058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:16.412913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 956/1880] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:16 2022] PUT /identity/v3/projects/e0dc7b0285d1473894d72580989c54d1/users/cb31b65a4e684a7bbb228b7986e2a8d0/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:16.425610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.426058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.426447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.482378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] MFA Rules not processed for user `cb31b65a4e684a7bbb228b7986e2a8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:16.485534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:16.515459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:16.600694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 925/1881] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:16.627037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:16.629063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:16.697723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:16.794102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba6a0-55e0-4ae3-a0aa-7223c1d17ede admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:16.804005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:16.805232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:16.805906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:16.806524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:16.820437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:16.823245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:16.844401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 957/1882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:18.368131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:18.370808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:18.579353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a8528-38e1-453e-aeef-53bec76f6262 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:18.604319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:18.605093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:18.605415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:18.605693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] PATH_INFO: `/v3/users/5f1b3a50127f4548a20907a9c42b889d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:18.606840 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1b3a50127f4548a20907a9c42b889d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:18.609051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:18.698334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1b3a50127f4548a20907a9c42b889d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:18.720556 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1b3a50127f4548a20907a9c42b889d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:18.737640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1b3a50127f4548a20907a9c42b889d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:18.741553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1b3a50127f4548a20907a9c42b889d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:18.756264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6b20ecab-5731-4f04-992f-95b274a7e428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1b3a50127f4548a20907a9c42b889d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:18.770189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 926/1883] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:18 2022] DELETE /identity/v3/users/5f1b3a50127f4548a20907a9c42b889d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:19.125145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:19.149664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3e47f-fcec-4c04-9bd6-52f949766ab8 service glance] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:19.291451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:19.297415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:19.303734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:19.305002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] PATH_INFO: `/v3/projects/c3cfa27d581a422c9dc22f3be5139ad8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:19.310337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cfa27d581a422c9dc22f3be5139ad8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:19.336710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:19.440690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cfa27d581a422c9dc22f3be5139ad8', 'request_id': 'req-86fa2751-8ea4-4e8c-915b-91a8d0a68777'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:19.457553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cfa27d581a422c9dc22f3be5139ad8', 'request_id': 'req-86fa2751-8ea4-4e8c-915b-91a8d0a68777'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:19.473781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cfa27d581a422c9dc22f3be5139ad8', 'request_id': 'req-86fa2751-8ea4-4e8c-915b-91a8d0a68777'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:19.496829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] The token cache is being invalidate because project c3cfa27d581a422c9dc22f3be5139ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:19.497305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:19.497902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-86fa2751-8ea4-4e8c-915b-91a8d0a68777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:19.499712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 958/1884] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:19 2022] DELETE /identity/v3/projects/c3cfa27d581a422c9dc22f3be5139ad8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:19.505147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:19.506146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:19.506505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:19.529691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:19.531181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:19.603295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:19.642159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 927/1885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:19.650355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:19.650882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:19.651154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:19.715265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:19.718069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:19.741413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 959/1886] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:19.745660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:19.758498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12063342-eb4c-4d9c-a405-23b6d20be0c3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:19.765641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:19.766368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:19.767507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:19.767786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:19.768583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:19.768964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:19.770808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:19.795670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 928/1887] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:19.800202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:19.818090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611be2d-56cc-423c-88d0-80918018ac92 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:19.825783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:19.826686 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:19.827156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:19.827586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:19.828391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:19.830604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:19.893278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 960/1888] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:19 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:19.894757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:19.909832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b75d-ba32-4995-a17d-c66d68c1d41c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:20.088243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:20.088898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.089216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.089436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.090076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:20.092009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:20.137025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 929/1889] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:19 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:20.137634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:20.150713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b666-8d34-4988-9d8d-15ee3ed258d1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:20.156066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:20.156906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.157591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.157874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.158544 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:20.161299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:20.200074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:20.210479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 961/1890] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:20.214027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e077da-b84d-4748-9b26-f58626544fa0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:20.219705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:20.223439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.224011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.224437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.225372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:20.227159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd079-5084-4530-a739-464c29c568f4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:20.247243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:20.248582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 930/1891] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:20.254658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:20.261785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824439fd-5cbe-4fb5-9fb2-f0589a470fcc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:20.273965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:20.275136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.275618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.276069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] PATH_INFO: `/v3/projects/ff86c5afa8124aa88bcd4daa96d09a38/users/d9008d891b2f4013bf4eb6eb27eafed5/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.308742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff86c5afa8124aa88bcd4daa96d09a38, user_id=d9008d891b2f4013bf4eb6eb27eafed5, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:20.315258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:20.367191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 962/1892] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:20 2022] PUT /identity/v3/projects/ff86c5afa8124aa88bcd4daa96d09a38/users/d9008d891b2f4013bf4eb6eb27eafed5/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:20.369466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a312e2-5fd7-4318-ad27-3bb7f887f2d5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.369917 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a312e2-5fd7-4318-ad27-3bb7f887f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.370197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a312e2-5fd7-4318-ad27-3bb7f887f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.409356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-76a312e2-5fd7-4318-ad27-3bb7f887f2d5 None None] MFA Rules not processed for user `d9008d891b2f4013bf4eb6eb27eafed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:20.410834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-76a312e2-5fd7-4318-ad27-3bb7f887f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:20.532844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 931/1893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:20.542547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:20.544431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:20.645897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284d36-ceb5-407c-852b-9b2798f7e307 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:20.652855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:20.653835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:20.654441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:20.654915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:20.664928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:20.666868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:20.692925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 963/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:21.278507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:21.279106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:21.279385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:21.323080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] MFA Rules not processed for user `97ef071a7fcb4ac397be8a332cd7eddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:21.324878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:21.414507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:21.533723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 932/1895] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:21.536807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:21.538647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:21.644113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3adf-ba1a-4878-ad9b-6a79b2535390 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:21.649263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:21.649888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:21.650168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:21.650454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:21.651100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:21.653270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:21.705628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 964/1896] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:21 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:21.707479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:21.721504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559375-d515-4774-b70c-9b37eac0ad5b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:21.819975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:21.820915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:21.821046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:21.821452 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:21.822320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:21.824532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:21.858313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 933/1897] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:21 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:21.863183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:21.883995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b090-db82-4636-865a-5a88fd808611 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:21.890428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:21.892258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:21.893006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:21.893363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:21.894598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:21.897058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:21.912163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 965/1898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:21.917107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:21.929219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5755d7-f5b2-45dd-ad4b-f966d482ce7b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:21.938767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:21.939624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:21.940858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:21.941241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] PATH_INFO: `/v3/projects/1a7785d69a7942d689112cb593726d89/users/814b829a052f43959efb05a29a7e0cca/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:21.964594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7785d69a7942d689112cb593726d89, user_id=814b829a052f43959efb05a29a7e0cca, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:21.984398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:22.006042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 934/1899] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:21 2022] PUT /identity/v3/projects/1a7785d69a7942d689112cb593726d89/users/814b829a052f43959efb05a29a7e0cca/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:22.010038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:22.025068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebeb55-dd27-447b-8c79-f6371d7d90f0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:22.074757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:22.102078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:22.102681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:22.102962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:22.103233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:22.103909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:22.105569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:22.116121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 966/1900] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:22.120155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:22.133072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346e38-66b6-4f46-95a4-a0bb07eb95a6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:22.139312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:22.140268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:22.140618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:22.140900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] PATH_INFO: `/v3/projects/1a7785d69a7942d689112cb593726d89/users/814b829a052f43959efb05a29a7e0cca/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:22.144054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7785d69a7942d689112cb593726d89, user_id=814b829a052f43959efb05a29a7e0cca, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:22.147758 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7151c-2664-47cb-9128-55c23674e8c6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:22.189799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 935/1901] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:22 2022] PUT /identity/v3/projects/1a7785d69a7942d689112cb593726d89/users/814b829a052f43959efb05a29a7e0cca/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:24.527654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:24.529693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:24.547161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760092ab-cfe3-4ea6-9851-a9114722e81a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:24.681548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:24.682473 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:24.682970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:24.683477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] PATH_INFO: `/v3/users/e88267da8a264feaa12e6cc41153e5c8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:24.684756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88267da8a264feaa12e6cc41153e5c8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:24.686839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:24.786853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88267da8a264feaa12e6cc41153e5c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:24.807404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88267da8a264feaa12e6cc41153e5c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:24.819445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88267da8a264feaa12e6cc41153e5c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:24.831154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88267da8a264feaa12e6cc41153e5c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:24.831835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88267da8a264feaa12e6cc41153e5c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:24.845521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 967/1902] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:24 2022] DELETE /identity/v3/users/e88267da8a264feaa12e6cc41153e5c8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:24.849818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52913f-146a-4e64-abc7-573852993044 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:24.850309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52913f-146a-4e64-abc7-573852993044 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:24.850411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52913f-146a-4e64-abc7-573852993044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:24.876152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9b52913f-146a-4e64-abc7-573852993044 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:24.877557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b52913f-146a-4e64-abc7-573852993044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:24.956279 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 936/1903] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:24.963149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:24.964807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:25.043357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d52728-1e3d-4fb4-8c60-9209c484c55d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:25.051436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:25.052084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:25.052366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:25.052680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:25.062878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:25.064629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:25.066368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:25.082937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 968/1904] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:22:25.576634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52913f-146a-4e64-abc7-573852993044 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:25.578355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b52913f-146a-4e64-abc7-573852993044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:25.609485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52913f-146a-4e64-abc7-573852993044 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:25.618760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:25.620036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:25.620849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:25.622694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] PATH_INFO: `/v3/projects/5d99560318b345c382eeb1c655dd2b46` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:25.624396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d99560318b345c382eeb1c655dd2b46)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:25.627434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:25.719705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:25.858149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d99560318b345c382eeb1c655dd2b46', 'request_id': 'req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:25.878566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d99560318b345c382eeb1c655dd2b46', 'request_id': 'req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:25.890560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d99560318b345c382eeb1c655dd2b46', 'request_id': 'req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:25.942948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] The token cache is being invalidate because project 5d99560318b345c382eeb1c655dd2b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:25.943238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:25.944085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ea57c7ac-1aec-4a63-8e83-f3a97e1b25bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:25.947873 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 937/1905] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:25 2022] DELETE /identity/v3/projects/5d99560318b345c382eeb1c655dd2b46 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:26.796867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:26.798676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:26.813713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d80f-bc53-4fec-ac16-b1e44ef8b9bb service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:26.910190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:26.910749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:26.911030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:26.911307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] PATH_INFO: `/v3/users/d9008d891b2f4013bf4eb6eb27eafed5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:26.913037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9008d891b2f4013bf4eb6eb27eafed5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:26.915880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:26.974036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9008d891b2f4013bf4eb6eb27eafed5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:26.996610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9008d891b2f4013bf4eb6eb27eafed5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:27.004872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9008d891b2f4013bf4eb6eb27eafed5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:27.014949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9008d891b2f4013bf4eb6eb27eafed5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:27.015729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9008d891b2f4013bf4eb6eb27eafed5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:27.026256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 969/1906] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:26 2022] DELETE /identity/v3/users/d9008d891b2f4013bf4eb6eb27eafed5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:27.028238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:27.028774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:27.028853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:27.060796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:27.062196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:27.192793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 938/1907] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:27.207296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:27.209025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:27.347913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97775105-5215-4026-85ec-b25d994b0f0e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:27.353114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:27.354011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:27.355026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:27.355490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:27.380066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:27.381682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4796e9-f4e1-41ca-b8fb-898ae7b7a7ee service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:27.399185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 970/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:27.962674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:27.964210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:27.998364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a0761-50c4-4000-bf80-8c7efcbe4603 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.017128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.017839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.018118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.018573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] PATH_INFO: `/v3/projects/ff86c5afa8124aa88bcd4daa96d09a38` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.019989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff86c5afa8124aa88bcd4daa96d09a38)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.022551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.112282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff86c5afa8124aa88bcd4daa96d09a38', 'request_id': 'req-0a91d295-2b2c-4a92-a7a7-912c159620c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:28.123551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff86c5afa8124aa88bcd4daa96d09a38', 'request_id': 'req-0a91d295-2b2c-4a92-a7a7-912c159620c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:28.137287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff86c5afa8124aa88bcd4daa96d09a38', 'request_id': 'req-0a91d295-2b2c-4a92-a7a7-912c159620c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:28.171449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] The token cache is being invalidate because project ff86c5afa8124aa88bcd4daa96d09a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:28.171688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:28.172791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a91d295-2b2c-4a92-a7a7-912c159620c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:28.179375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 939/1909] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:27 2022] DELETE /identity/v3/projects/ff86c5afa8124aa88bcd4daa96d09a38 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:28.181103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d845-4656-4078-b715-222874ecea5f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.181555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d845-4656-4078-b715-222874ecea5f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.182904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d845-4656-4078-b715-222874ecea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.233170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4f82d845-4656-4078-b715-222874ecea5f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:28.234540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4f82d845-4656-4078-b715-222874ecea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.266975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:28.333763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.334060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.334334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.370104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 971/1910] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:28.371918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.372381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.372903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.399650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:28.401299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.412436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] MFA Rules not processed for user `814b829a052f43959efb05a29a7e0cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:28.413703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.418704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 972/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:28.423840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.428251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:28.439381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da33a-cb5b-4a13-81be-5d308213cdd1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.464809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.465726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.466326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.466745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.467567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:28.467874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.469891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.483461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 973/1912] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:22:28.489031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.509776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24fdf2-354e-4545-ac4e-f6591a877218 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.516739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.517629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.518064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.518569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.519449 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.521689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.535383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 940/1913] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:28.551392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.553860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.567009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 974/1914] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:28.568633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.662127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272c4e2-9646-4520-8d66-f9fdf377898d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.671769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53e0c-1af5-467d-a85a-0f4c5590da56 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.683058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.683603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.683877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.684296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.684960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.686889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.720746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 975/1915] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/users => generated 278 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:28.727613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.737247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37c671-5dac-4a29-9e4c-e43a2ba53d2a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.743823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.745151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.745442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.746095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.746801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.748528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.751197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.752099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.752385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.753368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.755635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.764064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 976/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:28.767699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.778765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7078e-9baf-44ef-bb1b-ef23441df7c5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.785218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.785976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.786364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.786737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.787824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.789778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.810084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 977/1917] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:28.811126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:28.825126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2052-5890-4e1d-9fe6-2ee762047d3d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:28.832864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:28.833628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.834087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.834451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] PATH_INFO: `/v3/projects/44a3928f854a4b5f92b99af3959f19de/users/56f9f244109b4c6095fc95e1ea1741e7/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.842062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:28.856410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a3928f854a4b5f92b99af3959f19de, user_id=56f9f244109b4c6095fc95e1ea1741e7, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.859625 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240d6ff-45b1-44a0-bd7b-a456335849a8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.880768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:28.882696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:28.884740 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 978/1918] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:28 2022] PUT /identity/v3/projects/44a3928f854a4b5f92b99af3959f19de/users/56f9f244109b4c6095fc95e1ea1741e7/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:28.894301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:28.894720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:28.895065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:28.899612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 941/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:28.940650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] MFA Rules not processed for user `56f9f244109b4c6095fc95e1ea1741e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:28.942106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:28.952325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:29.059933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 979/1920] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:29.065380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.082749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0305a-7188-434e-a668-9516baf04e2c service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.187334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.191599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.191867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.192078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.192797 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.194982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.242954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 942/1921] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:29 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:29.246114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.262134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd3e41-89f6-4e56-a5e3-a1610e1ed3bb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.368621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.369320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.369666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.370008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.370870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.373023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.404062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 980/1922] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:29 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:29.408849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.423338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0623776-edfd-4b73-bf1a-d6dd6083e040 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.429389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.430012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.430298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.430575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.431485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.434656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.451953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 943/1923] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:29.454200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.475056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695eec3-b40d-4d8d-ba6b-31667e39f7bb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.489987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.491311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.491891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.492559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] PATH_INFO: `/v3/projects/bca1f635af3e4815925a595b40ef8f90/users/28e1ba159d6d4436825be68e594b6ae3/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.520736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca1f635af3e4815925a595b40ef8f90, user_id=28e1ba159d6d4436825be68e594b6ae3, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.526515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.547263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 981/1924] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:29 2022] PUT /identity/v3/projects/bca1f635af3e4815925a595b40ef8f90/users/28e1ba159d6d4436825be68e594b6ae3/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:29.552027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.566757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992e45-ecc9-4554-9773-6cf5d3087e71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.661884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.663000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.663962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.664523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.665609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.667512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c87e9-afb3-4993-a3c7-fd0ade0a9f06 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.684436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 944/1925] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:22:29.685964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:29.699422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6690405-3a07-41a7-bbf9-49bcbc46d7ba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:29.734097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:29.736576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.737083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.738304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] PATH_INFO: `/v3/projects/bca1f635af3e4815925a595b40ef8f90/users/28e1ba159d6d4436825be68e594b6ae3/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.743124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca1f635af3e4815925a595b40ef8f90, user_id=28e1ba159d6d4436825be68e594b6ae3, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:29.751993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:29.806340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 982/1926] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:29 2022] PUT /identity/v3/projects/bca1f635af3e4815925a595b40ef8f90/users/28e1ba159d6d4436825be68e594b6ae3/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:29.820911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:29.821202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:29.821486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:29.862354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] MFA Rules not processed for user `28e1ba159d6d4436825be68e594b6ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:29.862974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:29.956112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:30.007928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 945/1927] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:30.021948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:30.030682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:30.128010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd91e9-d409-4cce-b3a3-ce54cefe13a9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:30.133654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:30.134406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:30.134814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:30.135183 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:30.149049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:30.150723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba4751-2eb1-4df4-9c8a-4ad84bac3c1e service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:30.162535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 983/1928] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:30.264203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:30.277661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2c643-40e2-4009-b46f-7eeaf1c5219e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:30.281796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:30.282422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:30.282700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:30.282972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:30.390166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:30.392106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ef792-7698-47bc-a8f8-ea5a68664d18 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:30.402630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 946/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:30.518306 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:30.518811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:30.519283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:30.547140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:30.571847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] MFA Rules not processed for user `97ef071a7fcb4ac397be8a332cd7eddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:30.581382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:30.640845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 984/1930] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:33.849529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:33.850009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:33.850009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:33.872609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:33.873829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:33.941636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 947/1931] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:22:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:33.990804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:33.992258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:34.085485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3390861-5707-4a1f-9add-56b178e63501 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:34.091616 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:34.092444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:34.092860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:34.093135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:34.106602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:34.108814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b124204-fb9f-4417-ad05-89a178c4edcb service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:34.122301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 985/1932] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:22:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 19:22:43.934337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=63 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:44.117815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=55 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:46.605550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:46.680135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919421c-19d4-41ee-a9a2-bc085159205a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:46.684963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:46.685588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:46.685927 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:46.686321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] PATH_INFO: `/v3/users/56f9f244109b4c6095fc95e1ea1741e7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:46.687628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f9f244109b4c6095fc95e1ea1741e7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:46.689622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:46.747176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f9f244109b4c6095fc95e1ea1741e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:46.755403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f9f244109b4c6095fc95e1ea1741e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:46.774704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f9f244109b4c6095fc95e1ea1741e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:46.776198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f9f244109b4c6095fc95e1ea1741e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:46.793456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f9f244109b4c6095fc95e1ea1741e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:46.802414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 948/1933] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:46 2022] DELETE /identity/v3/users/56f9f244109b4c6095fc95e1ea1741e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:46.807638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:46.808167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:46.808450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:46.834116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:46.835669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:46.914195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 986/1934] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:46.927778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:46.930406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:47.004596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3316bef-da90-4af4-aded-380c1e8f8e07 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:47.008630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:47.009281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:47.009736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:47.010046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:47.021924 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:47.023530 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:47.036576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 949/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:47.594537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:47.597015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:47.647605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1dca-6f75-449e-99ed-427bb8359060 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:47.674897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:47.676932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:47.679391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:47.679721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] PATH_INFO: `/v3/projects/44a3928f854a4b5f92b99af3959f19de` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:47.682283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a3928f854a4b5f92b99af3959f19de)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:47.685779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:47.809569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a3928f854a4b5f92b99af3959f19de', 'request_id': 'req-f0a1dd94-e3d8-46aa-935e-7859cf76a122'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:47.828128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a3928f854a4b5f92b99af3959f19de', 'request_id': 'req-f0a1dd94-e3d8-46aa-935e-7859cf76a122'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:47.845512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a3928f854a4b5f92b99af3959f19de', 'request_id': 'req-f0a1dd94-e3d8-46aa-935e-7859cf76a122'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:47.867343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] The token cache is being invalidate because project 44a3928f854a4b5f92b99af3959f19de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:47.868353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:47.868852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:47.878915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 987/1936] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:47 2022] DELETE /identity/v3/projects/44a3928f854a4b5f92b99af3959f19de => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:47.883099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:47.894030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25961-6e73-48cf-b145-9c1ae304e0d0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:47.928737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:48.014284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:48.014934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:48.015216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:48.016235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] PATH_INFO: `/v3/users/28e1ba159d6d4436825be68e594b6ae3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:48.027688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e1ba159d6d4436825be68e594b6ae3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:48.034679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:48.104538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e1ba159d6d4436825be68e594b6ae3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.116246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e1ba159d6d4436825be68e594b6ae3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.135341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e1ba159d6d4436825be68e594b6ae3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.136115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e1ba159d6d4436825be68e594b6ae3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.150620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f731781b-3651-4a90-89a0-39d1b821a814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e1ba159d6d4436825be68e594b6ae3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.159367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 950/1937] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:47 2022] DELETE /identity/v3/users/28e1ba159d6d4436825be68e594b6ae3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:48.663484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:48.665582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:48.701221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1dd94-e3d8-46aa-935e-7859cf76a122 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:48.811926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:48.813887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:48.814577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:48.815593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] PATH_INFO: `/v3/projects/bca1f635af3e4815925a595b40ef8f90` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:48.817904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca1f635af3e4815925a595b40ef8f90)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:48.820358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:48.864311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:48.887264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca1f635af3e4815925a595b40ef8f90', 'request_id': 'req-4750661c-f475-4226-a9cb-c86fda47b8f9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.898653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca1f635af3e4815925a595b40ef8f90', 'request_id': 'req-4750661c-f475-4226-a9cb-c86fda47b8f9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.910068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca1f635af3e4815925a595b40ef8f90', 'request_id': 'req-4750661c-f475-4226-a9cb-c86fda47b8f9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.933738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] The token cache is being invalidate because project bca1f635af3e4815925a595b40ef8f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:48.934044 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.935067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4750661c-f475-4226-a9cb-c86fda47b8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:48.936808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 988/1938] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:48 2022] DELETE /identity/v3/projects/bca1f635af3e4815925a595b40ef8f90 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:48.942997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:48.943527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:48.943956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:48.974020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:48.975518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:49.046522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 951/1939] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:49.049849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.050191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.050490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.084431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:49.088034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:49.102207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 989/1940] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:49.106038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.116307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecb323-bb25-421b-aa85-4544d933f5be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.121596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.122230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.122539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.122808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.123484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:49.123781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.125986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.139734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 952/1941] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:49.144266 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.154155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db55b-0170-4a57-a5ce-3987af91246b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.160168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.161571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.161852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.162131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.162781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.164757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.199184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 990/1942] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:49.203443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.214245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f2ac-e117-4242-b4ae-ff06d88e9e7c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.248515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:49.295269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.295892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.296170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.296575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.298374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.300368 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.328529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 953/1943] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:49.331318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.342367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55004-7838-4442-870b-bc63f1e97515 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.348691 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.349501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.349780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.350054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.350710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.352311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.368246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 991/1944] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:49.372268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.384732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb17ed-b75c-43ec-a8b2-d30cefa20de6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.389689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.390741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.391214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.392443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.393250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.395166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca9fd-a609-455a-81be-70ba6c1e3a73 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.408756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 954/1945] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:49.413244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.425419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fd00-9544-47d3-9ca6-bfd53e011076 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.430609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.431379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.431922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.432222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] PATH_INFO: `/v3/projects/31f6930d6cd2483c8dc45ed4748c3c5d/users/5d1b438ad95e45c49640183909338cf5/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.450993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f6930d6cd2483c8dc45ed4748c3c5d, user_id=5d1b438ad95e45c49640183909338cf5, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.454122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.497212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 992/1946] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:49 2022] PUT /identity/v3/projects/31f6930d6cd2483c8dc45ed4748c3c5d/users/5d1b438ad95e45c49640183909338cf5/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:49.508753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.509096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.509312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.550610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] MFA Rules not processed for user `5d1b438ad95e45c49640183909338cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:49.552005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:49.584169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.586335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:49.646776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 955/1947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:49.653272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.691107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685510d-0773-4162-af69-42b64027f4eb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.697469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.698435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.698831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.699131 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] PATH_INFO: `/v3/users/cb31b65a4e684a7bbb228b7986e2a8d0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.700680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb31b65a4e684a7bbb228b7986e2a8d0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.704493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.786629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347abc-e616-4576-9d3d-f31ed61bdef8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:49.791966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:49.792770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.792914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.793175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.793816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:49.800558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:49.800778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb31b65a4e684a7bbb228b7986e2a8d0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:49.802737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:49.820999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb31b65a4e684a7bbb228b7986e2a8d0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:49.838279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb31b65a4e684a7bbb228b7986e2a8d0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:49.855031 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 956/1948] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:49.871612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb31b65a4e684a7bbb228b7986e2a8d0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:49.873129 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d21f74b6-0815-4be0-992a-84009fd7206c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb31b65a4e684a7bbb228b7986e2a8d0'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:49.874740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:49.887925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 993/1949] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:49 2022] DELETE /identity/v3/users/cb31b65a4e684a7bbb228b7986e2a8d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:49.891576 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:49.900435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:49.900435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:49.902600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:49.943199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:49.952008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:49.953958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:50.030394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182b47e-7a73-4578-9586-df9a456693de admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.088415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 994/1950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:50.099809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.101619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:50.156611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.157460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.157895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.158330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.159133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.161604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.198541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 957/1951] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:49 2022] POST /identity/v3/users => generated 297 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:50.199189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.202111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a978e-1144-4cc7-b2e4-36d23d3d9486 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.213576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.214657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.215232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.215619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.216701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fc898-ab49-4af5-9fed-c043a8f563a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.222151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.222768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.223050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.223324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.224008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.225883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.237488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.239238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.240749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 958/1952] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:50.245014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.256818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad2e13-f940-4bb0-9f54-ad7434a61bfa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.261273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 995/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:50.267015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.267959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.268506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.269208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] PATH_INFO: `/v3/projects/af03355229634620ba4e63d8a2bf4527/users/d112790b74fd4ab0838064d9d0fe8c1d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.291028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af03355229634620ba4e63d8a2bf4527, user_id=d112790b74fd4ab0838064d9d0fe8c1d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.294239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.317509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 959/1954] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:50 2022] PUT /identity/v3/projects/af03355229634620ba4e63d8a2bf4527/users/d112790b74fd4ab0838064d9d0fe8c1d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:22:50.322193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.338013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c342066-8aee-4796-9fbd-2c88b0f5f834 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.428568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.429489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.429997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.430606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.432065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.434550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398087f-7f06-4abe-9014-fc954cdaed26 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.449271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 996/1955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:50.455060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.469250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381526a7-49a9-45d2-b09b-e25469114a6b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.476449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.477720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.478288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.481731 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] PATH_INFO: `/v3/projects/af03355229634620ba4e63d8a2bf4527/users/d112790b74fd4ab0838064d9d0fe8c1d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.487746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af03355229634620ba4e63d8a2bf4527, user_id=d112790b74fd4ab0838064d9d0fe8c1d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.494718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.513701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 960/1956] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:50 2022] PUT /identity/v3/projects/af03355229634620ba4e63d8a2bf4527/users/d112790b74fd4ab0838064d9d0fe8c1d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:50.527184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.527748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.528186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.559380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:50.576321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] MFA Rules not processed for user `d112790b74fd4ab0838064d9d0fe8c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:50.577852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:50.660045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.662302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:50.752682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 997/1957] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:50.767158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:50.769268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:50.784800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803504d4-490e-4639-badf-eb4bacb9f95d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.795699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.797754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.798195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.798652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] PATH_INFO: `/v3/projects/e0dc7b0285d1473894d72580989c54d1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.799992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0dc7b0285d1473894d72580989c54d1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.803081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.816721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:50.841915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1705c-6977-466b-a701-93a7616bd9b4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:50.846511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:50.847166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:50.847408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:50.847738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:50.858035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:50.860499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:50.866792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0dc7b0285d1473894d72580989c54d1', 'request_id': 'req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:50.871318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 998/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:50.882091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0dc7b0285d1473894d72580989c54d1', 'request_id': 'req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:50.892710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0dc7b0285d1473894d72580989c54d1', 'request_id': 'req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:50.906859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] The token cache is being invalidate because project e0dc7b0285d1473894d72580989c54d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:50.907259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:50.908047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:50.924732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 961/1959] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:50 2022] DELETE /identity/v3/projects/e0dc7b0285d1473894d72580989c54d1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:51.327320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:51.337384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e538e-cb60-44cb-9d17-50cf6b764d76 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:51.430213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd112790b74fd4ab0838064d9d0fe8c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af03355229634620ba4e63d8a2bf4527', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:51.431216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:51.431568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:51.431793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:51.432475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:51.432794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:51.435623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:51.449424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 999/1960] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:51.454118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:51.457779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:51.479497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d2e6-88ee-4128-be8f-87f8b72f8605 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:51.484485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd112790b74fd4ab0838064d9d0fe8c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af03355229634620ba4e63d8a2bf4527', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:51.485199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:51.485489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:51.485770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:51.486411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:51.488332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:51.524506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 962/1961] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:51 2022] POST /identity/v3/projects => generated 353 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:22:51.526734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:51.540872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac39d1-15dd-41df-a2c4-7277d862c382 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:51.574698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:51.611363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd112790b74fd4ab0838064d9d0fe8c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af03355229634620ba4e63d8a2bf4527', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:51.612102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:51.612483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:51.612832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:51.613623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:51.614006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:51.615703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:51.632424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1000/1962] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:22:51.675321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:51.700945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671bc6e-ab2d-40fd-bfd7-97e3fd64e79a tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:51.706312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd112790b74fd4ab0838064d9d0fe8c1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af03355229634620ba4e63d8a2bf4527', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:51.708670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:51.708670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:51.708670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] PATH_INFO: `/v3/projects/a85faa4e0cde4e9ca1ecdea98ad6604d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:51.709001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a85faa4e0cde4e9ca1ecdea98ad6604d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:51.710866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:51.767929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85faa4e0cde4e9ca1ecdea98ad6604d', 'request_id': 'req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:51.782687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85faa4e0cde4e9ca1ecdea98ad6604d', 'request_id': 'req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:51.789415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85faa4e0cde4e9ca1ecdea98ad6604d', 'request_id': 'req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:51.809082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] The token cache is being invalidate because project a85faa4e0cde4e9ca1ecdea98ad6604d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:51.809369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:51.810049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ba6e8a1-23ca-4ff2-81b2-5eb0e0dc6bb8 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:51.820498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 963/1963] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:51 2022] DELETE /identity/v3/projects/a85faa4e0cde4e9ca1ecdea98ad6604d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:52.085499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:52.089042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:52.177580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6742b4-11c6-4654-b7ab-d1a062d24d78 tempest-VolumeQuotaClassesTest-2038762182 tempest-VolumeQuotaClassesTest-2038762182-project-admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:52.245898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:52.246584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:52.246828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:52.247105 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] PATH_INFO: `/v3/users/5d1b438ad95e45c49640183909338cf5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:52.248250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1b438ad95e45c49640183909338cf5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:52.253650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:52.318384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1b438ad95e45c49640183909338cf5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:52.333927 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1b438ad95e45c49640183909338cf5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:52.349480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1b438ad95e45c49640183909338cf5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:52.351662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:52.360288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1b438ad95e45c49640183909338cf5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:52.361180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1b438ad95e45c49640183909338cf5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:52.367843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1001/1964] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:52 2022] DELETE /identity/v3/users/5d1b438ad95e45c49640183909338cf5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:52.372980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:52.373257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:52.373539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:52.395521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:52.397151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:52.476251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 964/1965] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:52.484027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:52.485751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:52.583690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766590b-cb44-470b-b7c9-975c6af24e09 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:52.590760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:52.591873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:52.593120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:52.594454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:52.606703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:52.609339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:52.621535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1002/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:52.935757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:52.938322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:52.953748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:52.967754 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50aa32-4860-4a6b-baa4-58b5202de306 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:52.991173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:52.992135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:52.992574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:52.992842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] PATH_INFO: `/v3/projects/31f6930d6cd2483c8dc45ed4748c3c5d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:52.994492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f6930d6cd2483c8dc45ed4748c3c5d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:52.996969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:53.049943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f6930d6cd2483c8dc45ed4748c3c5d', 'request_id': 'req-99241731-63f5-43d7-9731-d66084a1af01'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.060676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f6930d6cd2483c8dc45ed4748c3c5d', 'request_id': 'req-99241731-63f5-43d7-9731-d66084a1af01'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.067910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f6930d6cd2483c8dc45ed4748c3c5d', 'request_id': 'req-99241731-63f5-43d7-9731-d66084a1af01'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.084804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] The token cache is being invalidate because project 31f6930d6cd2483c8dc45ed4748c3c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:53.085142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.085819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.087401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 965/1967] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:52 2022] DELETE /identity/v3/projects/31f6930d6cd2483c8dc45ed4748c3c5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:53.091479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:53.105310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419f4fd-7fc2-4823-b9ef-1a446811aa60 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:53.180057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:53.181070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:53.181427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:53.181735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] PATH_INFO: `/v3/users/d112790b74fd4ab0838064d9d0fe8c1d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:53.182896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d112790b74fd4ab0838064d9d0fe8c1d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:53.184892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:53.248542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd112790b74fd4ab0838064d9d0fe8c1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.266085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd112790b74fd4ab0838064d9d0fe8c1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.274220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd112790b74fd4ab0838064d9d0fe8c1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.283083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd112790b74fd4ab0838064d9d0fe8c1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.283734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c00f953-c4ab-4b0e-ac65-e51147c7662e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd112790b74fd4ab0838064d9d0fe8c1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.295082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1003/1968] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:22:53 2022] DELETE /identity/v3/users/d112790b74fd4ab0838064d9d0fe8c1d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:53.720815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:53.722821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:53.738677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99241731-63f5-43d7-9731-d66084a1af01 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:53.849396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:53.850117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:53.850573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:53.850845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] PATH_INFO: `/v3/projects/af03355229634620ba4e63d8a2bf4527` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:53.852729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af03355229634620ba4e63d8a2bf4527)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:53.854788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:53.931456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af03355229634620ba4e63d8a2bf4527', 'request_id': 'req-a375d1ba-9ac1-46ad-9bbf-f01420548920'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.943261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af03355229634620ba4e63d8a2bf4527', 'request_id': 'req-a375d1ba-9ac1-46ad-9bbf-f01420548920'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.950801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af03355229634620ba4e63d8a2bf4527', 'request_id': 'req-a375d1ba-9ac1-46ad-9bbf-f01420548920'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.967460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] The token cache is being invalidate because project af03355229634620ba4e63d8a2bf4527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:22:53.967887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.968717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a375d1ba-9ac1-46ad-9bbf-f01420548920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:22:53.970545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 966/1969] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:22:53 2022] DELETE /identity/v3/projects/af03355229634620ba4e63d8a2bf4527 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:53.977336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:53.977895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:53.978497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.000987 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:54.002304 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:54.014570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:54.082494 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1004/1970] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:22:54.084143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.084434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.084812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.111308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:54.112478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:54.123889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 967/1971] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:54.127854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.141219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c62810-2f1e-42cd-8fee-b80308a32615 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.145981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.147035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.147411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.147695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.148360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:22:54.148710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.150415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.166053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1005/1972] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:22:54.170110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.182945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823cf02-5859-4434-b706-2bd89566c238 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.188897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.189516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.189812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.190079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.190732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.192678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.199225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:54.228511 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 968/1973] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:54.234577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.243728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93f64b-deba-400b-a1e7-f1fa6f78e672 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.317673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.318294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.318584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.318860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.319560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.321525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.348124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1006/1974] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:54.352030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.363676 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b56693-1f25-4911-adc4-102f35099c50 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.372230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.372911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.373195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.373467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.374120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.375778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.391781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 969/1975] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:54.396106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.409257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd834b-bf74-420b-86e5-ab0bddcc3b77 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.415474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.416090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.416367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.416670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.417315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.418900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf8ccc-d23c-4549-ba1a-6657feaa718b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.431219 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1007/1976] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:54.435613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.446561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab462-53d0-453f-aa67-21b3ce61317c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.451286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.451948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.452223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.452524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] PATH_INFO: `/v3/projects/c00977568c414218abf8aa7375e026a5/users/dd0d86af63a5476ba5ff60472c4f0505/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.470147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00977568c414218abf8aa7375e026a5, user_id=dd0d86af63a5476ba5ff60472c4f0505, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.472846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.502372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 970/1977] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:54 2022] PUT /identity/v3/projects/c00977568c414218abf8aa7375e026a5/users/dd0d86af63a5476ba5ff60472c4f0505/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:54.504065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.504349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.504659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.540446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] MFA Rules not processed for user `dd0d86af63a5476ba5ff60472c4f0505`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:54.542413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:54.628335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1008/1978] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:54.633376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.707890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acdc53-076d-4aa7-ad4a-fa8146ebcc0c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.713411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.713979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.714302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.714588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.715265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.717264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.761986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 971/1979] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:54.762988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.784002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d39f-938b-44d2-8120-e9da4f8f206b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.798527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:54.880756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.883638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.884221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.884662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.885328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.887670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.929458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1009/1980] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:22:54 2022] POST /identity/v3/users => generated 310 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:22:54.933720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.950127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc37cb-45ae-4559-bfdf-340a86f4653c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:54.958739 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:54.959703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:54.961624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:54.961624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:54.961904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:54.964043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:54.976162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 972/1981] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:54.980596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:54.994141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ce723-fcdd-41b5-8a14-a3512bd7dc1b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:55.000542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:55.001315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.001670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.002019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] PATH_INFO: `/v3/projects/b8a2dea40f484e9698eb8748a69abbef/users/5a6e841ef97148be9178b70f03cd6f92/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.020776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a2dea40f484e9698eb8748a69abbef, user_id=5a6e841ef97148be9178b70f03cd6f92, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:55.023702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:55.040920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1010/1982] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:54 2022] PUT /identity/v3/projects/b8a2dea40f484e9698eb8748a69abbef/users/5a6e841ef97148be9178b70f03cd6f92/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:55.044995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:55.057016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcd748-d644-4550-bfbd-ab462b3bfd9b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:55.154094 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:55.154717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.155012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.155296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.156443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:55.158418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed75a54-00c6-4264-a6b9-9c10f9d64719 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:55.170328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 973/1983] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:22:55.175295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:55.195037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2962-e1b0-491c-acf7-a514d0734cd8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:55.205305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:55.206387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.206896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.207392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] PATH_INFO: `/v3/projects/b8a2dea40f484e9698eb8748a69abbef/users/5a6e841ef97148be9178b70f03cd6f92/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.209897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a2dea40f484e9698eb8748a69abbef, user_id=5a6e841ef97148be9178b70f03cd6f92, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:55.212912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:55.224700 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1011/1984] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:22:55 2022] PUT /identity/v3/projects/b8a2dea40f484e9698eb8748a69abbef/users/5a6e841ef97148be9178b70f03cd6f92/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:22:55.236832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.237103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.237475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.273013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] MFA Rules not processed for user `5a6e841ef97148be9178b70f03cd6f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:55.274640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:55.287036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:55.361698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 974/1985] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:22:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:55.373652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:55.376371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:55.455575 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48787e-bd67-4800-a0b8-916c8fcc34cf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:55.460280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:55.461459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.461784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.462244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.474596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:55.476369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a94641-c175-4dd7-9404-da01260997e2 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:55.488448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1012/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:55.669868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:55.681064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab39aa-26c3-4d8a-9179-c277747c4116 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:55.685098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:55.688152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:55.688152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:55.688152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:55.756957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:55.758543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:55.769412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 975/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:22:55 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:22:58.836034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:58.836715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:58.836715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:58.863666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:22:58.864940 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:58.925450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1013/1988] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:22:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:22:58.938912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:22:58.940324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:22:59.022503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6c1ae-9196-40c7-9500-e49bb90327fb service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:22:59.028329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:22:59.029122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:22:59.029587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:22:59.030190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:22:59.043227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:22:59.045103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:22:59.055084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 976/1989] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:22:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:23:01.045147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.047042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.059481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:01.116624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669bc0-34fe-4d3a-b9ae-130b88f5c9da None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.121073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.121729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.122006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.122278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] PATH_INFO: `/v3/users/d1f15f28bba84ac89fd9902dfe168468` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.123396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f15f28bba84ac89fd9902dfe168468)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.125482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.172487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f15f28bba84ac89fd9902dfe168468'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.184363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f15f28bba84ac89fd9902dfe168468'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.191356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f15f28bba84ac89fd9902dfe168468'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.199975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f15f28bba84ac89fd9902dfe168468'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.200143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f15f28bba84ac89fd9902dfe168468'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.206324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1014/1990] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:01 2022] DELETE /identity/v3/users/d1f15f28bba84ac89fd9902dfe168468 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:01.418422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.429886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21537914-f8c3-4a8d-bb16-7aa466283d98 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.464911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:01.491541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.492183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.492492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.492774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] PATH_INFO: `/v3/users/dd0d86af63a5476ba5ff60472c4f0505` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.493897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0d86af63a5476ba5ff60472c4f0505)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.495825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.558251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.560253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.572262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0d86af63a5476ba5ff60472c4f0505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.592304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0d86af63a5476ba5ff60472c4f0505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.595168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670caa-6cc5-43d3-ad4b-5cd6d34e9f80 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.608850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0d86af63a5476ba5ff60472c4f0505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.610154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0d86af63a5476ba5ff60472c4f0505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.614172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.615424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.615973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.616324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] PATH_INFO: `/v3/projects/a637a869f9ce44dca576ce4fd3153ee8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.619452 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a637a869f9ce44dca576ce4fd3153ee8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.621571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.629837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ebc7d24d-50ad-4e36-a00e-587ec01e949f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0d86af63a5476ba5ff60472c4f0505'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.638414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 977/1991] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:01 2022] DELETE /identity/v3/users/dd0d86af63a5476ba5ff60472c4f0505 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:01.643532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.643824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.644103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.666430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:01.667708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.695436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a637a869f9ce44dca576ce4fd3153ee8', 'request_id': 'req-5547942d-d449-45ec-b580-dc3eacc49392'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.707243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a637a869f9ce44dca576ce4fd3153ee8', 'request_id': 'req-5547942d-d449-45ec-b580-dc3eacc49392'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.720821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a637a869f9ce44dca576ce4fd3153ee8', 'request_id': 'req-5547942d-d449-45ec-b580-dc3eacc49392'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.733180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] The token cache is being invalidate because project a637a869f9ce44dca576ce4fd3153ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:01.733509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.735536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5547942d-d449-45ec-b580-dc3eacc49392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:01.740312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1015/1992] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:01 2022] DELETE /identity/v3/projects/a637a869f9ce44dca576ce4fd3153ee8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:01.742493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7edc7-5120-46ed-8b3f-6fc8a173e649 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.742900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7edc7-5120-46ed-8b3f-6fc8a173e649 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.743285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7edc7-5120-46ed-8b3f-6fc8a173e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.753308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 978/1993] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:01.767808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.769414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.778472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-24a7edc7-5120-46ed-8b3f-6fc8a173e649 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:01.780081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-24a7edc7-5120-46ed-8b3f-6fc8a173e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.786606 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:01.841900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c048b3-2c0b-4fe0-bd38-849da33838aa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.852273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:01.856703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1016/1994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:01.866646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.866871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.867119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.890054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:01.892441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:01.901194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1017/1995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:01.905243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.905558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.906479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.906701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.906896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.916711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461a548-2a6c-43af-a7d6-38e435df927d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.920161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.922422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.923388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.924108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.924287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.924628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.925282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:23:01.925588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.927231 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.935931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 979/1996] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:23:01.943167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1018/1997] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:23:01.947355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:01.957430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726140b-b069-4a4c-8823-2b8e1551eb30 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:01.962324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:01.962952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:01.963240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:01.963498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:01.964214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:01.966309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:01.996689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 980/1998] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:23:01 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:23:02.001031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.011726 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b70e09-8929-4ba3-bbf7-c4dbd3d578b3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.071383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.072787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.073256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.073536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.074211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.076179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.103921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1019/1999] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:23:01 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:23:02.105440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.117989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db0fa-5da6-455d-94a6-5fa407d1ccd1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.122859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.123472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.124138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.124138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.125110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.126397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.139341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 981/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:02.143410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.154420 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c65753-b46c-4639-b59d-5425233c87e0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.160381 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.161161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.161542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.161913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.162658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.164357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf07422-28ab-441e-9dcd-66b3be94b275 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.182414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1020/2001] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:02.182928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.193541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df9369-d5ce-42ec-95cb-2c91f671a74a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.198358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.199015 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.199297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.199570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] PATH_INFO: `/v3/projects/e48a6c8c8d0244d989c60d5c54496e23/users/1b070a09620e42f1933f461bc1318ea3/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.215886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48a6c8c8d0244d989c60d5c54496e23, user_id=1b070a09620e42f1933f461bc1318ea3, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.219184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.232126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 982/2002] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:23:02 2022] PUT /identity/v3/projects/e48a6c8c8d0244d989c60d5c54496e23/users/1b070a09620e42f1933f461bc1318ea3/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:23:02.242171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.242453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.242736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.278565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] MFA Rules not processed for user `1b070a09620e42f1933f461bc1318ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:02.279878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.343442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:02.347622 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1021/2003] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:02.359311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.361098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.397053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.398602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.431507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a5fd7-32c0-4f94-9be4-a6354f4895e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.436891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.437687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.437909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.438155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.448080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.449570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.461467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 983/2004] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:02.485239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb4842-8869-4c5e-a84b-0c508b7b74a9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.489745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.492976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.493751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.494035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.494311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] PATH_INFO: `/v3/projects/c00977568c414218abf8aa7375e026a5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.495450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00977568c414218abf8aa7375e026a5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.498091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.502484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403bc87-865e-4e73-baf0-c216450e09b6 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.507877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.508616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.509045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.509433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] PATH_INFO: `/v3/users/1b070a09620e42f1933f461bc1318ea3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.510670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b070a09620e42f1933f461bc1318ea3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.512798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.555737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00977568c414218abf8aa7375e026a5', 'request_id': 'req-3d32ca23-8b91-4131-8462-8db8d03574c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.565794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00977568c414218abf8aa7375e026a5', 'request_id': 'req-3d32ca23-8b91-4131-8462-8db8d03574c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.576546 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00977568c414218abf8aa7375e026a5', 'request_id': 'req-3d32ca23-8b91-4131-8462-8db8d03574c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.584759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b070a09620e42f1933f461bc1318ea3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.591776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] The token cache is being invalidate because project c00977568c414218abf8aa7375e026a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:02.593918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:02.594167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.596678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.598410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1022/2005] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:02 2022] DELETE /identity/v3/projects/c00977568c414218abf8aa7375e026a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:23:02.598944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b070a09620e42f1933f461bc1318ea3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.602423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.604179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.617033 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b070a09620e42f1933f461bc1318ea3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.618155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b070a09620e42f1933f461bc1318ea3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.631383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-989ef6fe-1d0e-4a83-9adf-caf7c160cefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b070a09620e42f1933f461bc1318ea3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.638712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 984/2006] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:02 2022] DELETE /identity/v3/users/1b070a09620e42f1933f461bc1318ea3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:02.643242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.643838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.644189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.669303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:02.670513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.684022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ca23-8b91-4131-8462-8db8d03574c7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.729685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:02.740819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 985/2007] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:02.753212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:02.754683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:02.758122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.758839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.759188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.759530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] PATH_INFO: `/v3/users/5a6e841ef97148be9178b70f03cd6f92` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.760895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6e841ef97148be9178b70f03cd6f92)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.762904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.833500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6e841ef97148be9178b70f03cd6f92'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.837994 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a070c88-bd38-4b91-9447-eb5b4a25d70f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:02.847890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:02.849166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:02.849826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:02.850106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:02.852196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6e841ef97148be9178b70f03cd6f92'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.862705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6e841ef97148be9178b70f03cd6f92'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.863057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:02.865538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:02.872870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6e841ef97148be9178b70f03cd6f92'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.873994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6e841ef97148be9178b70f03cd6f92'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:02.877826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 986/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:02.882747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1023/2009] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:02 2022] DELETE /identity/v3/users/5a6e841ef97148be9178b70f03cd6f92 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:03.252203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.253770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.263897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.266317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.272496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb259be4-3cd5-4bda-a5bf-72d9a1a53db0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.338388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5872-4bde-42a3-b6d3-149687169412 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.344408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.345570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.346119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.346406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] PATH_INFO: `/v3/projects/b8a2dea40f484e9698eb8748a69abbef` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.347761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a2dea40f484e9698eb8748a69abbef)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.350559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.353933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.354635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.354853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.355127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] PATH_INFO: `/v3/projects/e48a6c8c8d0244d989c60d5c54496e23` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.356251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48a6c8c8d0244d989c60d5c54496e23)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.358195 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.376403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:03.404445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a2dea40f484e9698eb8748a69abbef', 'request_id': 'req-ea9fc94d-82b0-4467-a4a3-0354033239de'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.413653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48a6c8c8d0244d989c60d5c54496e23', 'request_id': 'req-82c56f70-8d7d-41d5-b234-b97c94eec3ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.414741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a2dea40f484e9698eb8748a69abbef', 'request_id': 'req-ea9fc94d-82b0-4467-a4a3-0354033239de'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.417783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:03.424079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48a6c8c8d0244d989c60d5c54496e23', 'request_id': 'req-82c56f70-8d7d-41d5-b234-b97c94eec3ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.424435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a2dea40f484e9698eb8748a69abbef', 'request_id': 'req-ea9fc94d-82b0-4467-a4a3-0354033239de'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.431907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48a6c8c8d0244d989c60d5c54496e23', 'request_id': 'req-82c56f70-8d7d-41d5-b234-b97c94eec3ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.438030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] The token cache is being invalidate because project b8a2dea40f484e9698eb8748a69abbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:03.438330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.438982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea9fc94d-82b0-4467-a4a3-0354033239de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.444077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1024/2010] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:03 2022] DELETE /identity/v3/projects/b8a2dea40f484e9698eb8748a69abbef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:03.445639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e398d-7164-4929-96d0-82f2a34bdd04 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.445939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e398d-7164-4929-96d0-82f2a34bdd04 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.446208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e398d-7164-4929-96d0-82f2a34bdd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.452331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] The token cache is being invalidate because project e48a6c8c8d0244d989c60d5c54496e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:03.452732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.453619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-82c56f70-8d7d-41d5-b234-b97c94eec3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:03.456597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 987/2011] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:03 2022] DELETE /identity/v3/projects/e48a6c8c8d0244d989c60d5c54496e23 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:03.460760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605ec3-1fe2-42ca-ae95-422e417902bd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.461524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605ec3-1fe2-42ca-ae95-422e417902bd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.461811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605ec3-1fe2-42ca-ae95-422e417902bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.471277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c69e398d-7164-4929-96d0-82f2a34bdd04 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:03.472961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c69e398d-7164-4929-96d0-82f2a34bdd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.495211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5b605ec3-1fe2-42ca-ae95-422e417902bd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:03.496865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b605ec3-1fe2-42ca-ae95-422e417902bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.549070 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1025/2012] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:03.556688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.557061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.557406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.584539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 988/2013] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:03.585082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:03.585082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.588316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.588850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.589265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.597232 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1026/2014] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:03.598291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.608618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac5d07-22ea-4cf9-a37d-f8ddb6d8b760 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.613518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.614271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.614551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.614818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.615470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:23:03.615648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:03.615756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.616903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:03.617355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.625978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 989/2015] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:03.631427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1027/2016] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:23:03.637542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.641599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.647561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7692d12-0503-410d-97f3-498482dc94ec None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.653466 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.653609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c9af-f7bd-4f6a-86b0-1a982369f1de admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.654106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.654339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.656727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.657380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:23:03.657691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.659317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.659877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.660615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.660963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.661308 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.662405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.664091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.673229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 990/2017] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:23:03.677536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.689202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70367761-2630-4b09-90cd-355529b1d4a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.697323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.698166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.698448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.698722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.699357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.700540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1028/2018] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:23:03.701362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.704640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.733402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 991/2019] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:23:03.738013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.774774 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd132-b6b4-4e05-a666-ee7ffc30d4d9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.820591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd31ebc-e3e0-4260-9521-7d7afcb4ec89 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.824321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.824965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.825249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.825526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.826262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.828777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.839853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:03.845367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:03.857880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 992/2020] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:23:03.859628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.862265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.864525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.864525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.864884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.865620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.869445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.872259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cd18-b5a4-44f7-ad60-ac5102c7712f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.877470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.878081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.878358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.878699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.879297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.881168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.896912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 993/2021] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:03.901124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.903482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1029/2022] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:23:03 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:23:03.910276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.913847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e85cd-5b09-4a55-a431-f974792a1454 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.921079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.922416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.922757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.923062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.924135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.926005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.927949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32f47-d2bb-4232-a2ab-0a3109f85190 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.937972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.938562 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.938839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.939110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.940082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.941729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:03.944283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 994/2023] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:03.948883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.960934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1030/2024] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:23:03.962109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3d9c-b787-4d5d-a090-368686029ae5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.964203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:03.974632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b261cf4-b216-428c-aee0-e43b5e4196b5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:03.974853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.975780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.976288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.976665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] PATH_INFO: `/v3/projects/2b2cc805459443219f091812a247314d/users/31717a55cdab4151949cfde5cd25498f/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.981742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:03.982359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:03.982640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:03.982916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:03.983569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:03.986085 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:04.001282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2cc805459443219f091812a247314d, user_id=31717a55cdab4151949cfde5cd25498f, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:04.005028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5308885-8bff-4c85-8c01-fbaf540dc590 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:04.005280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1031/2025] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:04.008760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:04.022431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288936f-fd14-4c00-8ae9-9d99c1219993 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:04.023870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 995/2026] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:23:03 2022] PUT /identity/v3/projects/2b2cc805459443219f091812a247314d/users/31717a55cdab4151949cfde5cd25498f/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:04.029036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.029326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.029725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:04.051122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:04.052397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:04.100975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:04.101742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.102025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.102303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] PATH_INFO: `/v3/projects/d380af8a6a0b48069acb73eb3c799ddd/users/0d25f25c89054d02834dc851e6dd32c7/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:04.120824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d380af8a6a0b48069acb73eb3c799ddd, user_id=0d25f25c89054d02834dc851e6dd32c7, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:04.124891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb69d-0bff-4a86-af3c-fbfbbc0c6a5b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:04.135983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 996/2027] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:04.142885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1032/2028] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:23:04 2022] PUT /identity/v3/projects/d380af8a6a0b48069acb73eb3c799ddd/users/0d25f25c89054d02834dc851e6dd32c7/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:04.145283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:04.146693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:04.153725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.154013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.154287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:04.183697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] MFA Rules not processed for user `0d25f25c89054d02834dc851e6dd32c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:04.184863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:04.208942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc0db-2c8a-4e98-9aa1-ec79e35b4dfe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:04.252287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1033/2029] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:04.259593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:04.260208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.260519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.260825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:04.263295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:04.264669 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:04.278330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:04.300984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:04.324199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3aedd-8f0f-4305-8b38-616ab1b51d38 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:04.324386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:04.325834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2879e6-bcb0-4f29-b493-40d77fd8f86b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:04.328023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:04.328652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.328930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.329200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:04.335645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 997/2030] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:04.337610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:04.339036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:04.349362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1034/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:23:04.991966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606bbc-542a-4df4-b7c3-568b76d34df6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:04.992429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606bbc-542a-4df4-b7c3-568b76d34df6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:04.992702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606bbc-542a-4df4-b7c3-568b76d34df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:05.031709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cb606bbc-542a-4df4-b7c3-568b76d34df6 None None] MFA Rules not processed for user `31717a55cdab4151949cfde5cd25498f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:05.033053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cb606bbc-542a-4df4-b7c3-568b76d34df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:05.120726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 998/2032] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:05.128982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:05.130688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:05.200371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeba7e-7f0d-4868-b534-3648a1adf3a4 service glance] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:05.206355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:05.206911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:05.207199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:05.207481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:05.218910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:05.221189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:05.233175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1035/2033] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:23:06.645627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d6e5-9876-4ec9-bd84-6d17048d512a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:06.646146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d6e5-9876-4ec9-bd84-6d17048d512a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:06.646256 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d6e5-9876-4ec9-bd84-6d17048d512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:06.665964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fa13d6e5-9876-4ec9-bd84-6d17048d512a None None] MFA Rules not processed for user `31717a55cdab4151949cfde5cd25498f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:06.667293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fa13d6e5-9876-4ec9-bd84-6d17048d512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:06.674340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 999/2034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:14.086212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:14.088434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:14.101184 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de967-bc8e-4576-88e6-ae405ffcb31b service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:14.105538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:14.106450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:14.106854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:14.107379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:14.110510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:14.178925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:14.180352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:14.190337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1036/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:14.378007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106d21-9486-41da-a584-989ffda9e2f1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:14.378512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106d21-9486-41da-a584-989ffda9e2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:14.378741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106d21-9486-41da-a584-989ffda9e2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:14.412934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a8106d21-9486-41da-a584-989ffda9e2f1 None None] MFA Rules not processed for user `fd2e5a20bdeb4fe3abe152d2abbe9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:14.414790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a8106d21-9486-41da-a584-989ffda9e2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:14.479992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1000/2036] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:24.185559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=67 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:24.472964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:26.361450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:26.381772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef4d7-7fd5-47ef-8b5f-ad95085e50b8 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:26.387060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:26.387693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:26.387977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:26.388270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] PATH_INFO: `/v3/users/0d25f25c89054d02834dc851e6dd32c7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:26.390944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d25f25c89054d02834dc851e6dd32c7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:26.393311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:26.454540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d25f25c89054d02834dc851e6dd32c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:26.472394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d25f25c89054d02834dc851e6dd32c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:26.481891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d25f25c89054d02834dc851e6dd32c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:26.491762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d25f25c89054d02834dc851e6dd32c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:26.492641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d25f25c89054d02834dc851e6dd32c7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:26.501263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1037/2037] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:26 2022] DELETE /identity/v3/users/0d25f25c89054d02834dc851e6dd32c7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:26.505888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:26.506534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:26.506534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:26.527736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:26.528616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:26.600399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1001/2038] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:26.611340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:26.612838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:26.673878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4063c7-07c4-47c7-b29b-4f543633716f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:26.677576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:26.678179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:26.678457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:26.678728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:26.689862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:26.691323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90363-d0c4-4900-9a88-6ef6a739fb0c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:26.701050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1038/2039] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:26.997640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.000231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:27.015180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c529665-e0b4-46d9-8ae8-8bd9708d594c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.021207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.021881 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.022161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.022429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] PATH_INFO: `/v3/projects/d380af8a6a0b48069acb73eb3c799ddd` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.023664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d380af8a6a0b48069acb73eb3c799ddd)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.025608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.077082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd380af8a6a0b48069acb73eb3c799ddd', 'request_id': 'req-45b90d1b-3ece-4320-8910-117977709b68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:27.085292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd380af8a6a0b48069acb73eb3c799ddd', 'request_id': 'req-45b90d1b-3ece-4320-8910-117977709b68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:27.092952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd380af8a6a0b48069acb73eb3c799ddd', 'request_id': 'req-45b90d1b-3ece-4320-8910-117977709b68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:27.107044 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] The token cache is being invalidate because project d380af8a6a0b48069acb73eb3c799ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:27.107340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:27.108580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45b90d1b-3ece-4320-8910-117977709b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:27.110583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1002/2040] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:26 2022] DELETE /identity/v3/projects/d380af8a6a0b48069acb73eb3c799ddd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:27.116192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.116527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.116817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.140277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:27.141536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:27.211350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1039/2041] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:27.220872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.221192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.221477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.241425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:27.242549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:27.250666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1003/2042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:27.255188 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.266565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301a437-3e06-4cef-8ead-f15cc5a26c6c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.271165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.271768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.272041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.272311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.272985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:23:27.273287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.274868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.290702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1040/2043] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:23:27.292961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.302606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075749fb-a69e-444c-80f8-c84642affe3d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.307374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.308008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.308291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.308602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.309249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.311684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.341213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1004/2044] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:23:27 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:23:27.345450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.350665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:27.357597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a4272-a443-495b-8cee-12a6456d4c64 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.416903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.417559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.418342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.418648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.419273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.421484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.450903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1041/2045] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:23:27 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:23:27.452849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.467420 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de838df-a6c2-42f5-9d92-1583ea987eea admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.474546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.475222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.475646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.475922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.476607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.478252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.492121 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1005/2046] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:27.493236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.504367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88b22-8a9b-4cf0-af85-f8e3be5a4010 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.518110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.518731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.519016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.519292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.519949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.521581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15138c7-d392-4d05-bd96-739417aa9465 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.538162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1042/2047] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:23:27.541221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.559821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f61d0-6588-44a7-89ca-375994986056 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.566957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.568025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.568397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.568799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] PATH_INFO: `/v3/projects/b368ab525ddc4bac862070150d165407/users/680d0439c32944bbaa9f781f0e4a053b/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.588064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b368ab525ddc4bac862070150d165407, user_id=680d0439c32944bbaa9f781f0e4a053b, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.591720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.606910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1006/2048] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:23:27 2022] PUT /identity/v3/projects/b368ab525ddc4bac862070150d165407/users/680d0439c32944bbaa9f781f0e4a053b/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:27.617798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.618084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.618389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.649710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] MFA Rules not processed for user `680d0439c32944bbaa9f781f0e4a053b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:27.650956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:27.719256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1043/2049] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:27.731021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:27.733904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:27.757482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:27.796930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085c77-d4ee-4a8b-abb5-12dfa5112171 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:27.800685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:27.801280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:27.801564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:27.801844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:27.810803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:27.812966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb161f2-42ff-47da-a525-7e0180e274c6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:27.823553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1007/2050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:37.715888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:37.818922 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=17 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:37.993133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:38.058844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967398c2-8070-4d81-a118-ab6ff6ae71c0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:38.063813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:38.064442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:38.064753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:38.065028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] PATH_INFO: `/v3/users/680d0439c32944bbaa9f781f0e4a053b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:38.066146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680d0439c32944bbaa9f781f0e4a053b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:38.068066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:38.119413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680d0439c32944bbaa9f781f0e4a053b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.132837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680d0439c32944bbaa9f781f0e4a053b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.140560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680d0439c32944bbaa9f781f0e4a053b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.147949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680d0439c32944bbaa9f781f0e4a053b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.148607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680d0439c32944bbaa9f781f0e4a053b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.155055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1044/2051] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:23:37 2022] DELETE /identity/v3/users/680d0439c32944bbaa9f781f0e4a053b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:23:38.160027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:38.160312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:38.160642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:38.182825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:38.184119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:38.246219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1008/2052] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:38.256493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:38.257902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:38.317273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c513-a2f6-4cf7-9ad3-d5dc5efb1121 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:38.321073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:38.321702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:38.321986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:38.322263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:38.332011 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:38.333467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f0dc0-d3fc-4cdb-a74f-2bad0a170e74 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:38.342889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1045/2053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:23:38.622105 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:38.624095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:38.638063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b12675-ce01-4377-8304-aed5846e60d1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:38.644846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:38.645730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:38.646106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:38.646384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] PATH_INFO: `/v3/projects/b368ab525ddc4bac862070150d165407` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:38.647520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b368ab525ddc4bac862070150d165407)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:38.649549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:38.708199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b368ab525ddc4bac862070150d165407', 'request_id': 'req-f355b351-d907-4361-b97c-80efb0d16c82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.715944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b368ab525ddc4bac862070150d165407', 'request_id': 'req-f355b351-d907-4361-b97c-80efb0d16c82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.722236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b368ab525ddc4bac862070150d165407', 'request_id': 'req-f355b351-d907-4361-b97c-80efb0d16c82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.735091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] The token cache is being invalidate because project b368ab525ddc4bac862070150d165407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:23:38.735377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.736158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f355b351-d907-4361-b97c-80efb0d16c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:23:38.737826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1009/2054] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:23:38 2022] DELETE /identity/v3/projects/b368ab525ddc4bac862070150d165407 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:23:44.622945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056264-ee3d-4c30-98ca-5b7eefe50ccb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:44.623642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056264-ee3d-4c30-98ca-5b7eefe50ccb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:44.623642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056264-ee3d-4c30-98ca-5b7eefe50ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:44.643411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ba056264-ee3d-4c30-98ca-5b7eefe50ccb None None] MFA Rules not processed for user `7f29a88591064a67bdb7644471beeb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:44.644647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ba056264-ee3d-4c30-98ca-5b7eefe50ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:44.661419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:44.702654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1046/2055] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:48.731600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:53.054072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dc613-d06f-441e-a908-dd309e5791ac None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:53.054914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dc613-d06f-441e-a908-dd309e5791ac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:53.054914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dc613-d06f-441e-a908-dd309e5791ac None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:53.056343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1010/2056] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 31 19:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:23:53.061727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6925-0c36-4a5b-a4f5-34a0a61d690c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:53.062996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6925-0c36-4a5b-a4f5-34a0a61d690c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:53.063574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d6925-0c36-4a5b-a4f5-34a0a61d690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:53.090173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4c0d6925-0c36-4a5b-a4f5-34a0a61d690c None None] MFA Rules not processed for user `582fecc260bd4947994cb41bc05ca111`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:53.091891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4c0d6925-0c36-4a5b-a4f5-34a0a61d690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:53.168446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1047/2057] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 31 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:23:53.176408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dc613-d06f-441e-a908-dd309e5791ac None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:53.190600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dc613-d06f-441e-a908-dd309e5791ac None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:53.196500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:53.197114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:53.197397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:53.197741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:53.199414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:53.212834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:53.214407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:53.226093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1011/2058] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:23:56.920291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c09a-59b8-4cc8-9499-98d0fc603343 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:56.920815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c09a-59b8-4cc8-9499-98d0fc603343 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:56.920982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c09a-59b8-4cc8-9499-98d0fc603343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:56.941781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d556c09a-59b8-4cc8-9499-98d0fc603343 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:23:56.943013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d556c09a-59b8-4cc8-9499-98d0fc603343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:57.002150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1048/2059] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:23:57.019403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:23:57.020828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:23:57.097541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044df6-31fc-4623-b92a-5aa07650a230 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:23:57.103157 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:23:57.103771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:23:57.104049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:23:57.104319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:23:57.113234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:23:57.114798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:23:57.124355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1012/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:02.031092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997f5c4-a8cc-46ed-9f4b-8024b23f83e1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:02.031635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997f5c4-a8cc-46ed-9f4b-8024b23f83e1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:02.031635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997f5c4-a8cc-46ed-9f4b-8024b23f83e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:02.052451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5997f5c4-a8cc-46ed-9f4b-8024b23f83e1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:02.053678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5997f5c4-a8cc-46ed-9f4b-8024b23f83e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:02.062103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1049/2061] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:02.077666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:02.088713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bac18-da76-43f5-99f9-36bd816d039b service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:02.094827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:02.095429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:02.095709 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:02.095984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:02.104411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:02.106038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:02.116533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1013/2062] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:05.221865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896968e1-47fc-4c9f-a6a3-4d7e5a4bbbc5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:05.222440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896968e1-47fc-4c9f-a6a3-4d7e5a4bbbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:05.222549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896968e1-47fc-4c9f-a6a3-4d7e5a4bbbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:05.242388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-896968e1-47fc-4c9f-a6a3-4d7e5a4bbbc5 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:05.243648 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-896968e1-47fc-4c9f-a6a3-4d7e5a4bbbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:05.301116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1050/2063] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:05.357972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:05.359430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:05.431538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125acc39-7fc6-4f92-b85f-0bff6c9a9577 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:05.437449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:05.438061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:05.438345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:05.438619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:05.447735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:05.449352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:05.457716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1014/2064] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:24:06.354146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa84e88-4bb8-4708-8b69-28b3f9eb7934 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:06.355005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa84e88-4bb8-4708-8b69-28b3f9eb7934 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:06.355476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa84e88-4bb8-4708-8b69-28b3f9eb7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:06.364281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:06.378090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4fa84e88-4bb8-4708-8b69-28b3f9eb7934 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:06.379571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4fa84e88-4bb8-4708-8b69-28b3f9eb7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:06.389229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1051/2065] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:06.408302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:06.410528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:06.428164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6f0b-d8b3-4f98-858b-f36330869244 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:06.437327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:06.437951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:06.438229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:06.438501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:06.449266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:06.451105 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:06.473558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1015/2066] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:10.499152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d62f0-ab23-40b4-855c-4d0d43cc294a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:10.500016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d62f0-ab23-40b4-855c-4d0d43cc294a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:10.500310 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d62f0-ab23-40b4-855c-4d0d43cc294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:10.527560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-af9d62f0-ab23-40b4-855c-4d0d43cc294a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:10.530348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-af9d62f0-ab23-40b4-855c-4d0d43cc294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:10.539656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1052/2067] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:10.559155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:10.573215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b27b6-0b4b-4d86-b4a5-a0835d28a03b service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:10.601695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:10.604523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:10.604523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:10.604523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:10.617493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:10.619668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:10.645988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1016/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:15.792882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4ec0-3635-46d2-ab64-88a547db596e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:15.793383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4ec0-3635-46d2-ab64-88a547db596e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:15.793481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa4ec0-3635-46d2-ab64-88a547db596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:15.814174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9ffa4ec0-3635-46d2-ab64-88a547db596e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:15.815383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9ffa4ec0-3635-46d2-ab64-88a547db596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:15.823278 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1053/2069] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:24:15.841708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:15.852804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de487444-51b9-475c-9106-7165bbb331a8 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:15.859190 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:15.859793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:15.860074 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:15.860370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:15.868897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:15.870457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05de41-f417-4a4c-96dd-0bf2c03ef4d4 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:15.880724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1017/2070] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:19.552422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.552985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.552985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.554319 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1054/2071] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:24:19.565753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7e22d-185d-4058-b241-e72375fe7e46 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.566372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7e22d-185d-4058-b241-e72375fe7e46 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.566565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7e22d-185d-4058-b241-e72375fe7e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.575255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:19.592886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-37d7e22d-185d-4058-b241-e72375fe7e46 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:19.594267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37d7e22d-185d-4058-b241-e72375fe7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:19.604718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1018/2072] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:19.617355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:19.619045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:19.680297 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242521-8b83-4615-ae9a-dfa456ee8b17 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:19.684549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:19.684673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.684890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.685163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.695758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:19.697264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81cc72-99c6-4d88-a398-a740d6f23d38 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:19.708749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1055/2073] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:19.779367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.779648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.779923 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.781540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1019/2074] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:24:19.786583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35febf-fd97-4847-9a33-7ce88187fb66 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.786871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35febf-fd97-4847-9a33-7ce88187fb66 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.787178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35febf-fd97-4847-9a33-7ce88187fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.807388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4a35febf-fd97-4847-9a33-7ce88187fb66 None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:19.808640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4a35febf-fd97-4847-9a33-7ce88187fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:19.859619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1056/2075] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:19.871594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:19.873543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:19.887499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcecdcd-94f6-403c-9fba-7353d500ed04 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:19.892018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:19.892644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.892920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.893189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.900150 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:19.901706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc089da6-dc4f-472d-a9ab-1d3410b1349d service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:19.909344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1020/2076] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:19.990953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a2-b04b-44be-a1cc-4dad7209e075 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.991176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a2-b04b-44be-a1cc-4dad7209e075 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.991450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201969a2-b04b-44be-a1cc-4dad7209e075 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:19.992876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1057/2077] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:24:19.997680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb1f7-29e3-453e-9f07-3a8480c67efd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:19.997979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb1f7-29e3-453e-9f07-3a8480c67efd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:19.998287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb1f7-29e3-453e-9f07-3a8480c67efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:20.019546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3ecfb1f7-29e3-453e-9f07-3a8480c67efd None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:20.020783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3ecfb1f7-29e3-453e-9f07-3a8480c67efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:20.030745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1021/2078] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:20.042101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201969a2-b04b-44be-a1cc-4dad7209e075 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:20.053910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201969a2-b04b-44be-a1cc-4dad7209e075 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:20.057512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:20.058112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:20.058393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:20.058665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:20.068983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:20.070409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:20.081770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1058/2079] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:22.045791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3989a5-0366-47ab-82f5-80dcad226984 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:22.046343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3989a5-0366-47ab-82f5-80dcad226984 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:22.046343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3989a5-0366-47ab-82f5-80dcad226984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:22.067308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1e3989a5-0366-47ab-82f5-80dcad226984 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:22.069154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e3989a5-0366-47ab-82f5-80dcad226984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:22.086700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1022/2080] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:22.103126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:22.114385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbdaae-0391-47cf-bf27-e8f408b18eab service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:22.120098 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:22.120896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:22.121177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:22.121447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:22.130228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:22.131794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:22.141200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1059/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:24:23.310132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8dbaa-713c-4e8a-9145-795d48f0479e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:23.310592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8dbaa-713c-4e8a-9145-795d48f0479e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:23.310708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8dbaa-713c-4e8a-9145-795d48f0479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:23.330174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e0d8dbaa-713c-4e8a-9145-795d48f0479e None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:23.331379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e0d8dbaa-713c-4e8a-9145-795d48f0479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:23.338504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1023/2082] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:23.351100 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:23.363075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f0e58-884b-42ae-83bd-1d4b61fb26d3 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:23.368091 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:23.368721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:23.369002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:23.369277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:23.378398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:23.380020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:23.388061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1060/2083] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:24:33.325041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=17 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:33.384862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=75 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:52.605395 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c8b2-790c-4495-b8ad-b900e8e7d8f3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:52.606019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c8b2-790c-4495-b8ad-b900e8e7d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:52.606019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c8b2-790c-4495-b8ad-b900e8e7d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:52.626130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f3a1c8b2-790c-4495-b8ad-b900e8e7d8f3 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:52.627342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f3a1c8b2-790c-4495-b8ad-b900e8e7d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:52.635870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1024/2084] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:24:52.649029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:24:52.660020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ce389-b321-43ff-a0ab-f2452ed1ef9e service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:24:52.665269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:24:52.665861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:52.666166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:52.666442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:52.674252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:24:52.676367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8ec31-e82c-44e6-9e94-36db9426d4f3 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:24:52.684268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1061/2085] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:24:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:24:57.018875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:24:57.019732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:24:57.020022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:24:57.041826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] MFA Rules not processed for user `31717a55cdab4151949cfde5cd25498f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:24:57.042953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:24:57.101560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1025/2086] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:02.681067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:07.094128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=28 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:12.070424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879662-71a1-41dd-9fb0-dc2d58d75a89 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:12.070950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879662-71a1-41dd-9fb0-dc2d58d75a89 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:12.070950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879662-71a1-41dd-9fb0-dc2d58d75a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:12.090519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e5879662-71a1-41dd-9fb0-dc2d58d75a89 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:12.091721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e5879662-71a1-41dd-9fb0-dc2d58d75a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:12.099608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1062/2087] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:12.114172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:12.126775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5081-5e4d-42cf-8bb0-38614b43ef1a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:12.132809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:12.133402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:12.133679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:12.133966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:12.142051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:12.144292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:12.153775 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1026/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:16.370894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625424b2-ae53-48f5-b542-5f333c55656d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:16.371396 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625424b2-ae53-48f5-b542-5f333c55656d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:16.371495 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625424b2-ae53-48f5-b542-5f333c55656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:16.392149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-625424b2-ae53-48f5-b542-5f333c55656d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:16.393435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-625424b2-ae53-48f5-b542-5f333c55656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:16.401322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1063/2089] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:16.421625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:16.433335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194719f-5421-47dd-b62c-f71c31460cab service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:16.438866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:16.439457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:16.439765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:16.440055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:16.449860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:16.451438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:16.461309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1027/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:20.490371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef115-b1b8-4d30-a72a-56761d62a59a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:20.490956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef115-b1b8-4d30-a72a-56761d62a59a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:20.490956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef115-b1b8-4d30-a72a-56761d62a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:20.510753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-851ef115-b1b8-4d30-a72a-56761d62a59a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:20.511952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-851ef115-b1b8-4d30-a72a-56761d62a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:20.519838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1064/2091] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:20.534335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:20.545700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde501e-79c3-4fa7-8adc-ba7f33bc78f4 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:20.551541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:20.552128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:20.552405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:20.552729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:20.560934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:20.562528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:20.573165 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1028/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:24.657210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a387b-78fb-4984-9dfd-272a328d5093 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:24.657730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a387b-78fb-4984-9dfd-272a328d5093 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:24.657838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a387b-78fb-4984-9dfd-272a328d5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:24.678366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a02a387b-78fb-4984-9dfd-272a328d5093 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:24.679567 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a02a387b-78fb-4984-9dfd-272a328d5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:24.687373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1065/2093] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:24.705130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:24.716793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b94b6-b7dd-46c0-81fe-70ee5b100760 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:24.722781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:24.723401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:24.723678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:24.723952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:24.732000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:24.733674 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:24.743243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1029/2094] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:28.863911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7134c2-8be6-41c3-9eb9-afa01571a0b2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:28.864416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7134c2-8be6-41c3-9eb9-afa01571a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:28.864536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7134c2-8be6-41c3-9eb9-afa01571a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:28.884205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ce7134c2-8be6-41c3-9eb9-afa01571a0b2 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:28.885445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ce7134c2-8be6-41c3-9eb9-afa01571a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:28.894203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1066/2095] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Oct 31 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:28.909925 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:28.921328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e01ac-d63a-4e50-9d4b-751bd0dcb883 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:28.926889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:28.927469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:28.927771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:28.928042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:28.935945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:28.937553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67fb28-b178-47a5-8539-e8fb20f30b23 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:28.946751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1030/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:38.879054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=15 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:38.942606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:42.749517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:42.750013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:42.750110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:42.768657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] MFA Rules not processed for user `fd2e5a20bdeb4fe3abe152d2abbe9c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:42.769919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:42.825789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1067/2097] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:50.499763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:50.500243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:50.500406 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:50.528043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] MFA Rules not processed for user `7f29a88591064a67bdb7644471beeb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:25:50.529524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:50.538975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1031/2098] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:25:52.396786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:52.398256 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:52.410271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a7a8b-681d-4d66-a6e8-ee0cd4bbbbb7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:52.413874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:52.414733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:52.415020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:52.415296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:52.417075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:52.430324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:52.431775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6a3c-0382-4a8a-9c10-8bbc668f0fbd service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:52.443511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1068/2099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:25:54.973359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:25:54.983695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a954d-e33e-4329-ae0b-be0d8471947e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:25:54.987931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:25:54.989746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:25:54.990156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:25:54.990501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:25:54.992424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:25:55.007610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:25:55.009176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:25:55.022235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1032/2100] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:25:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:02.437821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=31 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:03.131746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:03.132035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:03.132314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:03.152612 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] MFA Rules not processed for user `f3bb55041a374035ad251e7706a144c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:03.153881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:03.213588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1069/2101] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:03.226903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:03.241387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320b93-080a-406f-bea8-94bd0f588d2f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:03.246884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:03.247618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:03.247934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:03.248176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:03.249999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:03.261300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:03.262893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:03.272519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1033/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:03.522841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:03.525921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:03.543810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49808a9-ed47-48d6-9979-7de9a73ee76f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:03.549488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:03.550276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:03.551366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:03.551703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:03.553481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:03.565569 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:03.567710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:03.578582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1070/2103] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:03.592144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:03.593979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:03.610221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04197-b343-4c23-b300-9e16a83836d2 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:03.633038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:03.633697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:03.633982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:03.634262 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] PATH_INFO: `/v3/users/31717a55cdab4151949cfde5cd25498f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:03.637668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31717a55cdab4151949cfde5cd25498f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:03.640206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:03.716834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31717a55cdab4151949cfde5cd25498f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:03.724764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31717a55cdab4151949cfde5cd25498f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:03.737981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31717a55cdab4151949cfde5cd25498f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:03.739064 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31717a55cdab4151949cfde5cd25498f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:03.748662 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd59651b-c3db-4fd6-a8fc-9b679b776717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31717a55cdab4151949cfde5cd25498f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:03.755749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1034/2104] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:26:03 2022] DELETE /identity/v3/users/31717a55cdab4151949cfde5cd25498f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:26:03.990643 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.002464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd6c36-ac2f-4def-a3d0-98db91328565 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.093267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.093923 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.094207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.094485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] PATH_INFO: `/v3/projects/2b2cc805459443219f091812a247314d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.095796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2cc805459443219f091812a247314d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.097992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.154960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2cc805459443219f091812a247314d', 'request_id': 'req-077cc017-b34f-47bd-a192-a8bb82f599c6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:04.164233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2cc805459443219f091812a247314d', 'request_id': 'req-077cc017-b34f-47bd-a192-a8bb82f599c6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:04.171780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2cc805459443219f091812a247314d', 'request_id': 'req-077cc017-b34f-47bd-a192-a8bb82f599c6'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:04.185716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] The token cache is being invalidate because project 2b2cc805459443219f091812a247314d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:26:04.185996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:04.186896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-077cc017-b34f-47bd-a192-a8bb82f599c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:26:04.188685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1071/2105] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:26:03 2022] DELETE /identity/v3/projects/2b2cc805459443219f091812a247314d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:26:04.196685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.197354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.197703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.225992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:04.227306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:04.298825 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1035/2106] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:04.307518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.308068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.308444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.330185 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:04.331665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:04.340785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1072/2107] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:04.345218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.357615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92fb6-494d-46fa-850a-6357099be1c7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.363550 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.364189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.364489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.364929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.365681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:26:04.366047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.367756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.382321 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1036/2108] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:26:04.386956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.397810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066926a9-99bd-4b52-a7d2-f0c3654e160b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.403218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.403833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.404113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.404388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.405076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.407074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.423547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:04.439467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1073/2109] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:26:04 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:26:04.444066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.454910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a7ef3-0c49-4e9f-832e-aa03c40d8977 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.485063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:04.527764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.528374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.528684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.528984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.529649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.531568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.558029 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1037/2110] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:26:04 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:26:04.562292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.576317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb5e18-85f6-4b70-9ca6-0b34dde8e465 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.582508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.583172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.583455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.583831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.584583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.586445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.601929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1074/2111] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:26:04.605802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.619068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0b805-4478-47e4-ad1c-21e0973cd066 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.625372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.625989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.626349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.626814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.627470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.629362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d8cb2-4b6d-4224-a9ae-33c626011904 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.641634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1038/2112] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:26:04.646674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.658412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82cf1-f2fc-4430-ba65-20e4c367da4b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.665393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.666198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.666547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.666895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] PATH_INFO: `/v3/projects/3a2d7267b8fe465187e0011311e10e00/users/67ed53d3d20d4c628f580a9a207dd548/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.684141 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2d7267b8fe465187e0011311e10e00, user_id=67ed53d3d20d4c628f580a9a207dd548, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.686968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.704089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1075/2113] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:26:04 2022] PUT /identity/v3/projects/3a2d7267b8fe465187e0011311e10e00/users/67ed53d3d20d4c628f580a9a207dd548/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:26:04.709997 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347942-5be3-4109-9a75-d655bcbc2f07 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.710349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347942-5be3-4109-9a75-d655bcbc2f07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.710690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347942-5be3-4109-9a75-d655bcbc2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.731701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-39347942-5be3-4109-9a75-d655bcbc2f07 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:04.732933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-39347942-5be3-4109-9a75-d655bcbc2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:04.807517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1039/2114] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:04.817411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:04.819259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:04.885247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71014c6-6afa-4e9e-b59a-d6d6966d12ac admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:04.888901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:04.889508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:04.889788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:04.890061 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:04.900113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:04.901600 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:04.911832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1076/2115] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:10.272477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.273053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.273053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.304681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] MFA Rules not processed for user `67ed53d3d20d4c628f580a9a207dd548`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:10.305848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:10.377408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1040/2116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:10.382704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.395324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0806-8821-4262-9911-0f3c0208ee91 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.400980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.401597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.402097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.402375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.403029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.404982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.442829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1077/2117] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:26:10.446948 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.462559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4f1f1-e6c4-45d3-901b-33c3a05aa31d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.499252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:10.533234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.533938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.534299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.534645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.535366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.537858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.570506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1041/2118] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:26:10 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:26:10.575122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.589911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c63a56-0456-464b-99cc-2eb95a3d3821 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.595472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.596224 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.596632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.597069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.598086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.599793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.617730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1078/2119] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:26:10.618952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.635661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87458-7bfb-40cf-8f07-b6b174a7ff90 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.641230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.641911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.642193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.642472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] PATH_INFO: `/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f/users/3434fabaf97b4d83aad1bf79d3162839/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.660599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcacb1356ca544efa6dced8d9c4ed07f, user_id=3434fabaf97b4d83aad1bf79d3162839, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.665498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.683426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1042/2120] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:26:10 2022] PUT /identity/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f/users/3434fabaf97b4d83aad1bf79d3162839/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:26:10.687438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.698239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7336-2fd5-44d3-944c-1e3e23fa1810 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.765428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.766062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.766346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.766627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.767284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.769477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5029c1d-f13f-4496-a195-64b7a4e25410 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.792515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1079/2121] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:26:10.797599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:10.809189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e5ca2-e951-4897-b093-06a7e7afddf4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:10.815263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:10.816649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:10.816941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:10.817239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] PATH_INFO: `/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f/users/3434fabaf97b4d83aad1bf79d3162839/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:10.819807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcacb1356ca544efa6dced8d9c4ed07f, user_id=3434fabaf97b4d83aad1bf79d3162839, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:10.822679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:10.834808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1043/2122] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:26:10 2022] PUT /identity/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f/users/3434fabaf97b4d83aad1bf79d3162839/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:26:15.215383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136ce0-d226-4d4f-8b7f-eba93a7d017c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:15.216497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136ce0-d226-4d4f-8b7f-eba93a7d017c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:15.216992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136ce0-d226-4d4f-8b7f-eba93a7d017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:15.254564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fd136ce0-d226-4d4f-8b7f-eba93a7d017c None None] MFA Rules not processed for user `3434fabaf97b4d83aad1bf79d3162839`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:15.256160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fd136ce0-d226-4d4f-8b7f-eba93a7d017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:15.287683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:15.384623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1080/2123] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:15.397357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:15.399110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:15.558957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda77c6-d022-4216-a280-9d79f414ed18 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:15.567005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:15.567892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:15.568519 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:15.568944 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:15.715742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:15.717374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:15.728838 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1044/2124] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:15.950426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431577a4-6ca7-49d5-b4ee-698e05702297 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:15.950891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431577a4-6ca7-49d5-b4ee-698e05702297 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:15.951169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431577a4-6ca7-49d5-b4ee-698e05702297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:15.975511 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-431577a4-6ca7-49d5-b4ee-698e05702297 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:15.976784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-431577a4-6ca7-49d5-b4ee-698e05702297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:16.069464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1081/2125] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:16.125509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:16.126956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:16.191539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:16.216964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462f920-2c67-4eec-ba26-7c4b7b1bbe81 service glance] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:16.223322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:16.224168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:16.224591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:16.224972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:16.234561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:16.236265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:16.246412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1045/2126] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:25.699448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:25.699955 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:25.700050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:25.719210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] MFA Rules not processed for user `67ed53d3d20d4c628f580a9a207dd548`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:25.720402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:25.727912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1082/2127] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:26:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:25.981086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:25.982515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:26.046096 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8ee3b-c39e-497e-b800-2ff61fc10a0b service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:26.049833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:26.050435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:26.050705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:26.050973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:26.052730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:26.062295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:26.063701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb84907-2adc-4d88-8c32-c8ebdc1e1965 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:26.072379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1046/2128] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:26.387772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:26.389257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:26.465610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a787c-83d0-4e3d-b8c3-3b29c0cf0b20 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:26.470706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:26.471320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:26.471649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:26.472317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:26.474022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:26.485884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:26.488430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:26.498800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1083/2129] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:27.944767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:27.945253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:27.945405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:27.965673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:27.966880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:27.974672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1047/2130] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:26:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:27.987603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:28.000684 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f3f91-1fad-4e2e-99cb-1f0e0790a492 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:28.006073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:28.007094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:28.007094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:28.007329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:28.015661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:28.017749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:28.029045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1084/2131] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:37.959968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=42 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:38.024770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:41.438583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:41.448302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c05965-c8ee-46dd-8539-f601eb6a9859 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:41.452159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:41.452794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:41.453073 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:41.453373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:41.455129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:41.465433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:41.466899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08daf-4ad8-47d3-ae5a-927cb5d4b3e7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:41.475710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1048/2132] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:42.228523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:42.230036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:42.307096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febefdf-6904-43cf-810b-b8e55b74bcdc service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:42.312579 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:42.313182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:42.313465 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:42.313739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:42.315994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:42.327779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:42.329385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ac97c-044f-424b-8e9a-e0e6c9e5293f service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:42.340703 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1085/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:44.579645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2696-3030-4e45-8ebc-b9e65f686752 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.580230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2696-3030-4e45-8ebc-b9e65f686752 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.580332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2696-3030-4e45-8ebc-b9e65f686752 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.581972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1049/2134] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:26:44.588619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdef1d-b3e0-49f7-a4e3-75c68f36b576 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.589109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdef1d-b3e0-49f7-a4e3-75c68f36b576 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.589216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdef1d-b3e0-49f7-a4e3-75c68f36b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.609092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b4cdef1d-b3e0-49f7-a4e3-75c68f36b576 None None] MFA Rules not processed for user `95f9f85aeb8642f2b2b97aff5d1be0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:44.610293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b4cdef1d-b3e0-49f7-a4e3-75c68f36b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:44.617413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1086/2135] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:44.635063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2696-3030-4e45-8ebc-b9e65f686752 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:44.646768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2696-3030-4e45-8ebc-b9e65f686752 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:44.650340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:44.650935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.651213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.651492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.660030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:44.661597 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2a2f3-533b-475b-acbf-b4279b909024 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:44.670218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1050/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:26:44.769384 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a251-b850-48b9-942f-519ee2dac027 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.769665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a251-b850-48b9-942f-519ee2dac027 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.769941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a251-b850-48b9-942f-519ee2dac027 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.771295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1087/2137] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:26:44.776593 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.776883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.777156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.797590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:26:44.798790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:44.808811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1051/2138] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:26:44.820099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a251-b850-48b9-942f-519ee2dac027 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:44.831916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a251-b850-48b9-942f-519ee2dac027 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:44.835430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:44.836021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:44.836301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:44.836614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:44.846906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:44.848318 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:44.858891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1088/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:47.090255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:47.091707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:47.106630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a4d3-a1bb-4e90-a30e-6af4c1302b38 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:47.115313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:47.116250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:47.117971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:47.118335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:47.120322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:47.136156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:47.137933 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:47.150845 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1052/2140] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:54.854264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=43 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:55.142089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:26:55.145886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:55.216162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a8d96-35fd-478c-b8c4-0d3799792520 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:26:55.219820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:26:55.220554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:26:55.224055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:26:55.224352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:26:55.226198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:26:55.289729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:26:55.291082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:26:55.302187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1089/2141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:26:57.144764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=21 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:02.796670 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:02.808034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812da6c-df6f-4f29-ad9c-80835619164a service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:02.811680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:02.812285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:02.812602 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:02.812880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:02.822807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:02.824276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:02.834598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1053/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:04.552031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:04.566162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058448d-3288-44ce-9e55-f078c2806a35 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:04.572333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:04.573052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:04.573406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:04.573746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:04.575552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:04.592487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:04.594330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:04.606250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1090/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:12.829745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:14.601195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=54 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:16.748422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:16.757642 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe42a3-aa42-4492-8640-ea707f8d03ad service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:16.761687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:16.762358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:16.762637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:16.762903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:16.764772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:16.828473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:16.829962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:16.840433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1054/2144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:20.107289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:20.109788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:20.126016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47dd2-ba70-4e07-9a36-df30bf1d3c56 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:20.132950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:20.133572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:20.133858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:20.134186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:20.136419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:20.153334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:20.155043 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:20.175491 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1091/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:20.176601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:20.178397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:20.195612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1fd7-34f6-4aed-b3f0-37b3fb624a85 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:20.200696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:20.201413 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:20.201698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:20.201973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] PATH_INFO: `/v3/users/fd2e5a20bdeb4fe3abe152d2abbe9c2e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:20.203109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2e5a20bdeb4fe3abe152d2abbe9c2e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:20.205076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:20.258178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2e5a20bdeb4fe3abe152d2abbe9c2e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.265079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2e5a20bdeb4fe3abe152d2abbe9c2e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.276860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2e5a20bdeb4fe3abe152d2abbe9c2e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.277636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2e5a20bdeb4fe3abe152d2abbe9c2e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.284299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ceba9f9-c706-4811-abf1-0e705ea9a195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2e5a20bdeb4fe3abe152d2abbe9c2e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.291316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1055/2146] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:27:20 2022] DELETE /identity/v3/users/fd2e5a20bdeb4fe3abe152d2abbe9c2e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:20.705954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:20.718180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ada54f-0162-4cec-8e65-166aa0074027 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:20.777857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:20.778502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:20.778780 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:20.779056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] PATH_INFO: `/v3/projects/a6ae957b746448a3b38f475d1fcbfab3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:20.780181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ae957b746448a3b38f475d1fcbfab3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:20.782122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:20.832312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ae957b746448a3b38f475d1fcbfab3', 'request_id': 'req-c5a991bf-0762-4554-9cf8-6929efc91319'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.839720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ae957b746448a3b38f475d1fcbfab3', 'request_id': 'req-c5a991bf-0762-4554-9cf8-6929efc91319'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.845979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ae957b746448a3b38f475d1fcbfab3', 'request_id': 'req-c5a991bf-0762-4554-9cf8-6929efc91319'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.856936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] The token cache is being invalidate because project a6ae957b746448a3b38f475d1fcbfab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:27:20.857226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.857903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c5a991bf-0762-4554-9cf8-6929efc91319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:20.859380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1092/2147] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:27:20 2022] DELETE /identity/v3/projects/a6ae957b746448a3b38f475d1fcbfab3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:20.864848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:20.865136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:20.865411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:20.885337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:20.886740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:20.947385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1056/2148] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:27:20.955965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:20.956393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:20.956710 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:20.976895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:20.978075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:20.986034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1093/2149] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:20.990592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.000254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51961a9-dae7-47a7-ade1-0a202ed655b5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.005055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.005648 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.005928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.006202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.006846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:27:21.007156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.008789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.010277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:21.022361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1057/2150] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:27:21.026501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.036144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2f02-7c6a-40fd-9daa-21b63c767e07 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.040971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.041555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.041833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.042103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.042727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.044631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.071152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1094/2151] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:21.075326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.085893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee9543-0083-4228-87e2-a6f62e4a1cdb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.142019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.142544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.143367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.143702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.144409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.146339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.167643 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1058/2152] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:21 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:27:21.171816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.181970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8c4c8-56f3-43d1-9f09-941e36fc6cdd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.186945 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.187536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.187811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.188081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.188757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.190963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.200771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1095/2153] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:21.204804 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.215310 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502c13-ca80-4ab7-b31b-aae15be5d061 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.220300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.220951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.221439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.221545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.222158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.223744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f978-31a6-410f-a1fc-80c889d03ce5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.235242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1059/2154] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:21.239518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.250362 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ad979-6f22-4cd1-a365-cc27de1d884f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.257543 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.258193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.258580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.258859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] PATH_INFO: `/v3/projects/2fa1abfa47b34124b9202faa3db8b158/users/023afe769fcc45d390b7af69f7c65051/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.275175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa1abfa47b34124b9202faa3db8b158, user_id=023afe769fcc45d390b7af69f7c65051, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.277842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.291277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1096/2155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:21 2022] PUT /identity/v3/projects/2fa1abfa47b34124b9202faa3db8b158/users/023afe769fcc45d390b7af69f7c65051/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:21.301365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.301745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.302020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.330039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] MFA Rules not processed for user `023afe769fcc45d390b7af69f7c65051`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:21.331855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:21.395624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1060/2156] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:27:21.407985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:21.410253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:21.425265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:21.489909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0805a8-23be-40b8-a0bc-e24f283e04dc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:21.495568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:21.496178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:21.496482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:21.496760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:21.505871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:21.507440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:21.516311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1097/2157] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:23.666668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:23.679280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e693-8b95-4dae-a97e-d9132a0f4ba2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:23.684724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:23.685313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:23.685590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:23.685861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:23.687547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:23.747715 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:23.749325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63a77a-0fbc-4b9c-9bb4-57cc96106b00 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:23.754436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:23.759473 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1061/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:24.186873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:24.250187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9daf51-f5a2-4add-a6bd-9166ae1172a8 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:24.255966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:24.256621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:24.256896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:24.257164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] PATH_INFO: `/v3/users/023afe769fcc45d390b7af69f7c65051` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:24.258268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=023afe769fcc45d390b7af69f7c65051)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:24.260169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:24.306660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023afe769fcc45d390b7af69f7c65051'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.319017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023afe769fcc45d390b7af69f7c65051'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.326315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023afe769fcc45d390b7af69f7c65051'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.333589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023afe769fcc45d390b7af69f7c65051'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.334206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023afe769fcc45d390b7af69f7c65051'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.340210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1098/2159] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:27:24 2022] DELETE /identity/v3/users/023afe769fcc45d390b7af69f7c65051 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:24.344781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:24.345075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:24.345334 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:24.365274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:24.366456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:24.424148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1062/2160] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:24.434577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:24.435911 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:24.455889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:24.494842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351955-ad38-4f00-8696-1651d244ce9e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:24.498374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:24.498966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:24.499244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:24.499512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:24.508803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:24.510340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915ad0-d25c-4971-8a74-8649669b6a3a service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:24.520023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1099/2161] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:24.801352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:24.803412 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:24.823397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f4b2d-87a8-4d7a-98cb-7f868e2f15da None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:24.839198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:24.839849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:24.840133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:24.840411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] PATH_INFO: `/v3/projects/2fa1abfa47b34124b9202faa3db8b158` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:24.841601 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa1abfa47b34124b9202faa3db8b158)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:24.843594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:24.896786 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa1abfa47b34124b9202faa3db8b158', 'request_id': 'req-830d6483-b698-4b7b-9025-b03f362a207f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.904510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa1abfa47b34124b9202faa3db8b158', 'request_id': 'req-830d6483-b698-4b7b-9025-b03f362a207f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.910795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa1abfa47b34124b9202faa3db8b158', 'request_id': 'req-830d6483-b698-4b7b-9025-b03f362a207f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.921942 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] The token cache is being invalidate because project 2fa1abfa47b34124b9202faa3db8b158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:27:24.922229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.922867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-830d6483-b698-4b7b-9025-b03f362a207f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:24.924365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1063/2162] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:27:24 2022] DELETE /identity/v3/projects/2fa1abfa47b34124b9202faa3db8b158 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:24.929942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:24.930230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:24.930505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:24.950172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:24.951361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:25.009001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1100/2163] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:25.016743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.017037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.017316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.037526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:25.038730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:25.046899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1064/2164] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:25.051067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.060741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a78e-d685-4f1e-b03f-fe6c405b2abd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.065201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.066312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.066587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.066858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.067501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:27:25.067803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.069422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.081808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1101/2165] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:27:25.085874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.095177 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb2dda-fd96-4ecd-8449-88620f2de82f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.100782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.101386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.101667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.101943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.102587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.104513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.135760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1065/2166] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:25 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:27:25.136939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.147488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc0a9b-e672-43d8-a40d-89f4a1b42dbe admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.209853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.210542 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.210892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.211239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.211953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.214448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.241150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1102/2167] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:25 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:27:25.243806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.259968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e8b9-731c-445d-aee2-1779cb5e154d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.269043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.269656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.269959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.270231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.270875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.272510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.288493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1066/2168] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:25.292772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.304264 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0156405-d492-4b56-ab1b-4d41a921aed4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.309290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.309930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.310214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.310488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.311136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.312786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2573fe1-5c89-41fd-b079-dd35ecb68f3e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.325042 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1103/2169] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:25.329197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.342640 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237287-e786-48d1-921d-37d901f6f01c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.349557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.350454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.351287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.351668 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] PATH_INFO: `/v3/projects/6a0747825cda4298a35a19edf382c732/users/d3261cdc3e3b4474b65f35edd5938d0c/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.368397 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0747825cda4298a35a19edf382c732, user_id=d3261cdc3e3b4474b65f35edd5938d0c, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.371140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.388895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1067/2170] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:25 2022] PUT /identity/v3/projects/6a0747825cda4298a35a19edf382c732/users/d3261cdc3e3b4474b65f35edd5938d0c/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:27:25.399951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.400393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.400808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.438789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] MFA Rules not processed for user `d3261cdc3e3b4474b65f35edd5938d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:25.439811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:25.454828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:25.532021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1104/2171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:27:25.543951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.545713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:25.569393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:25.626295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d50d-825d-45b2-8db2-db593705a841 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.632973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.633577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.633851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.634122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.642067 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.643824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9c8a-e2e1-4e4d-8312-51cdfbcc2fca service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.653090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1068/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:25.868776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:25.930468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508e61-0f4f-4acb-8820-43284b49491b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:25.934921 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:25.935564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:25.935845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:25.936119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] PATH_INFO: `/v3/users/d3261cdc3e3b4474b65f35edd5938d0c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:25.937260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3261cdc3e3b4474b65f35edd5938d0c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:25.939175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:25.985279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3261cdc3e3b4474b65f35edd5938d0c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:25.997132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3261cdc3e3b4474b65f35edd5938d0c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.003963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3261cdc3e3b4474b65f35edd5938d0c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.011077 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3261cdc3e3b4474b65f35edd5938d0c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.011698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3261cdc3e3b4474b65f35edd5938d0c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.017716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1105/2173] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:27:25 2022] DELETE /identity/v3/users/d3261cdc3e3b4474b65f35edd5938d0c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:26.022685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.023175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.023273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.042436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:26.043622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:26.102022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1069/2174] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:26.111795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.113869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:26.153371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:26.171990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6535c8-434f-40b1-872f-66f79bba11f3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.176111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.176728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.177006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.177269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.185908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.187315 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef6318-4a33-482d-a6d7-5687384f46a9 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.196991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1106/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:26.467111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.468574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:26.482799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997dae-ecb0-4cbf-9df0-dfebc553f84d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.490239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.491104 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.491478 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.491795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] PATH_INFO: `/v3/projects/6a0747825cda4298a35a19edf382c732` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.493297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0747825cda4298a35a19edf382c732)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.496339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.547232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0747825cda4298a35a19edf382c732', 'request_id': 'req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.555250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0747825cda4298a35a19edf382c732', 'request_id': 'req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.561115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0747825cda4298a35a19edf382c732', 'request_id': 'req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.572381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] The token cache is being invalidate because project 6a0747825cda4298a35a19edf382c732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:27:26.572697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.573327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3f73b5cb-40f8-4cb0-a4d4-c9067765e2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:26.574803 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1070/2176] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:27:26 2022] DELETE /identity/v3/projects/6a0747825cda4298a35a19edf382c732 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:27:26.579599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.580120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.580120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.599827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:26.601027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:26.657862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1107/2177] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:26.667702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.667984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.668258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.688147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:26.689357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:26.697132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1071/2178] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:26.701201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.710810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e6aab-0c46-4a02-bcf3-4bcc624c2c84 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.715350 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.715942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.716221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.716521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.717198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:27:26.717500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.719116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.731108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1108/2179] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:27:26.735355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.745131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54246-93fd-4ce5-9011-180c13380ace None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.751246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.751846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.752122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.752387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.753173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.755156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.777772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:26.794618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1072/2180] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:26 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:26.795928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.807423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917948b-43b0-4ee1-a27a-48a5e7c66037 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.866379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.867016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.867299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.867661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.868194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.870147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.892524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1109/2181] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:26 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:27:26.897495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.907577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14938-5ce3-4f40-97a6-3ff3995e0c9c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.913416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.914034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.914657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.914938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.915586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.917227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.927512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1073/2182] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:26.931467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.941409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dd860-7a30-4981-a6ff-c2dd2f356024 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.945939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.946521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.946804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.947074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.947715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.949330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3057-6f4e-4cd4-bce1-ff5d809a0e9d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:26.960269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1110/2183] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:26.964212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:26.975053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a926c0-ec35-4a71-b538-5af10755655e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:26.979667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:26.980305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:26.980623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:26.980897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] PATH_INFO: `/v3/projects/9c704a5fada24d918457baa8613ed6b1/users/c142f8d9844c49db83b7a8515ac726c2/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:26.995433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c704a5fada24d918457baa8613ed6b1, user_id=c142f8d9844c49db83b7a8515ac726c2, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:26.998198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.010805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1074/2184] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:26 2022] PUT /identity/v3/projects/9c704a5fada24d918457baa8613ed6b1/users/c142f8d9844c49db83b7a8515ac726c2/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:27.021785 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.022069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.022372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.050247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] MFA Rules not processed for user `c142f8d9844c49db83b7a8515ac726c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:27.051375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:27.083111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:27.115761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1111/2185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:27.120254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.182236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e113-0e51-4238-87b4-588d2113f628 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.186884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.187482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.187757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.188032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.188694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.191202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.217720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1075/2186] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:27 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:27.221782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.232561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6a3ec-3c4b-4bcb-bd8b-49af8c1f8fe0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.288530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.289375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.289664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.289935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.290598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.292522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.313897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1112/2187] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:27 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:27.317035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.327273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca35c8-9730-4465-9f9e-b26ef00bf594 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.332687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.333290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.333570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.333848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.334485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.336099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.346604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1076/2188] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:27.350696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.360639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bcb2b-55c2-47db-8fb5-bf21a72f2900 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.365229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.365864 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.366145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.366418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] PATH_INFO: `/v3/projects/d4df75a8eee1404db8be95014054c81b/users/77ca0fce70394256a16067e8fad0293d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.381326 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4df75a8eee1404db8be95014054c81b, user_id=77ca0fce70394256a16067e8fad0293d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.383947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.397681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1113/2189] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:27 2022] PUT /identity/v3/projects/d4df75a8eee1404db8be95014054c81b/users/77ca0fce70394256a16067e8fad0293d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:27.401543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.411582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24bd41-b287-49c7-ab5a-fc3a07da9caa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.467809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.468440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.468746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.469017 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.469699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.471287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e422-9f4a-4927-a460-09c3fd4364e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.481293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1077/2190] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:27.485458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.496561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cb746-f3c7-4b44-9a05-1fcb641d77dc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.501096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.501734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.502009 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.502280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] PATH_INFO: `/v3/projects/d4df75a8eee1404db8be95014054c81b/users/77ca0fce70394256a16067e8fad0293d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.504930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4df75a8eee1404db8be95014054c81b, user_id=77ca0fce70394256a16067e8fad0293d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.507555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.517482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1114/2191] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:27 2022] PUT /identity/v3/projects/d4df75a8eee1404db8be95014054c81b/users/77ca0fce70394256a16067e8fad0293d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:27.527749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.528032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.528305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.556509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] MFA Rules not processed for user `77ca0fce70394256a16067e8fad0293d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:27.557706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:27.582370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:27.630971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1078/2192] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:27.643533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.645429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:27.709497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a24ed-ee8f-4565-8e28-056b25e915db admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.713558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.714412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.715012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.715130 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.725724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.727155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab4274-0e6f-44ea-bc43-af47dee53d33 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:27.736682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1115/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:27 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:27.880679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:27.945977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3411-ecf9-4ad7-9e5c-b911343279e2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:27.950733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:27.951338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:27.951615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:27.951885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] PATH_INFO: `/v3/users/c142f8d9844c49db83b7a8515ac726c2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:27.953028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c142f8d9844c49db83b7a8515ac726c2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:27.954926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:28.009469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c142f8d9844c49db83b7a8515ac726c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.016849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c142f8d9844c49db83b7a8515ac726c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.029300 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c142f8d9844c49db83b7a8515ac726c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.030146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c142f8d9844c49db83b7a8515ac726c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.039529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c142f8d9844c49db83b7a8515ac726c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.045856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1079/2194] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:27:27 2022] DELETE /identity/v3/users/c142f8d9844c49db83b7a8515ac726c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:28.051427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:28.051723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:28.051997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:28.073090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:28.074314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:28.104274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:28.143002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1116/2195] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:27:28.153166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:28.154581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:28.199996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:28.214983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e829d5-51cb-4649-ad24-210bb58806dc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:28.218590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:28.219193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:28.219471 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:28.219744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:28.229225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:28.230679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:28.240746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1080/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:28.502635 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:28.504214 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:28.516476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eab04-e6a1-43e0-837e-2529591f9ae0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:28.521767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:28.522401 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:28.522681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:28.522951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] PATH_INFO: `/v3/projects/9c704a5fada24d918457baa8613ed6b1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:28.524155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c704a5fada24d918457baa8613ed6b1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:28.526114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:28.572431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c704a5fada24d918457baa8613ed6b1', 'request_id': 'req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.578958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c704a5fada24d918457baa8613ed6b1', 'request_id': 'req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.586083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c704a5fada24d918457baa8613ed6b1', 'request_id': 'req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.597434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] The token cache is being invalidate because project 9c704a5fada24d918457baa8613ed6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:27:28.597724 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.598371 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.599977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1117/2197] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:27:28 2022] DELETE /identity/v3/projects/9c704a5fada24d918457baa8613ed6b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:28.604026 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:28.614206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5d1a5-917d-4d84-9e97-99b45d2a5d48 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:28.670136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:28.670675 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:28.670951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:28.671219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] PATH_INFO: `/v3/users/77ca0fce70394256a16067e8fad0293d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:28.672418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ca0fce70394256a16067e8fad0293d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:28.674372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:28.719128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ca0fce70394256a16067e8fad0293d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.725934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ca0fce70394256a16067e8fad0293d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.737537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ca0fce70394256a16067e8fad0293d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.738189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ca0fce70394256a16067e8fad0293d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.744724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aaf1ef42-17d4-4601-951d-fe000fe5680b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ca0fce70394256a16067e8fad0293d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:28.750463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1081/2198] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:27:28 2022] DELETE /identity/v3/users/77ca0fce70394256a16067e8fad0293d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:29.043768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.045290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:29.058915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4f3b6-2a32-43c6-8df5-56d38160bdcc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.116894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.117325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.118089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.118089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] PATH_INFO: `/v3/projects/d4df75a8eee1404db8be95014054c81b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.119031 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4df75a8eee1404db8be95014054c81b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.121137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.169869 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4df75a8eee1404db8be95014054c81b', 'request_id': 'req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:29.175245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:29.178626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4df75a8eee1404db8be95014054c81b', 'request_id': 'req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:29.186696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4df75a8eee1404db8be95014054c81b', 'request_id': 'req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:29.198789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] The token cache is being invalidate because project d4df75a8eee1404db8be95014054c81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:27:29.199096 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:29.199741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc37c9a9-7c94-4c24-91e5-ccd08d32aebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:27:29.201246 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1118/2199] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:27:29 2022] DELETE /identity/v3/projects/d4df75a8eee1404db8be95014054c81b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:29.206214 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.206808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.206808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.231657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:29.232514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:29.294540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1082/2200] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:29.304084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.304504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.304787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.325534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:29.326736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:29.335127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1119/2201] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:27:29.339176 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.345765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:29.354070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48553-ebe2-426b-86c5-deedcba5140a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.359816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.360425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.360740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.361227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.361903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:27:29.363068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.365263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.378302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1083/2202] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:27:29.382729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.393177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2308a1-b380-4559-96fb-e6ed756e11b1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.398289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.398889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.399181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.399443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.400062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.402013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.430840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1120/2203] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:29.435039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.445653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1687-2511-48e6-94d9-eb9fd25f3313 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.508125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.508677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.509023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.509365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.510079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.512189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.539887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1084/2204] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:29.544016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.554746 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91922-d19f-45cb-ab98-7ba3598e2888 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.559244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.559834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.560108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.560379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.561082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.562664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.572521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1121/2205] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:29.576290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.586789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8255a-c20e-4697-85c2-1a0d99c99363 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.591458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.592050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.592333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.592644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.593286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.594919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90488d-0031-4c4b-a1aa-8785b3153249 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.606370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1085/2206] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:29.610633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.621020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b53d2-ce65-4087-b190-5f9f8f025361 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.625550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.626181 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.626461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.626732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] PATH_INFO: `/v3/projects/4e5c99eba6f04a58aef1f461e4fb59ff/users/4987e4d4d7d544ef8b1cd45b0e55da62/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.640914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5c99eba6f04a58aef1f461e4fb59ff, user_id=4987e4d4d7d544ef8b1cd45b0e55da62, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.643577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.656234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1122/2207] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:29 2022] PUT /identity/v3/projects/4e5c99eba6f04a58aef1f461e4fb59ff/users/4987e4d4d7d544ef8b1cd45b0e55da62/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:29.667382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.667665 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.667935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.696169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] MFA Rules not processed for user `4987e4d4d7d544ef8b1cd45b0e55da62`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:29.697336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:29.760381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1086/2208] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:29.764943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.825839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470078f-be7d-43b6-b5ff-1cad823351fb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.830376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.831482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.831758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.832030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.832692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.834570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.862055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1123/2209] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:29.866152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.876962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e3bf-ddf8-4937-babc-5e4f1dd2d918 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.929981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:29.936810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.937418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.937703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.937979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.938636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.941246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.962740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1087/2210] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:27:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:27:29.966679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:29.977602 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e6879-581a-4a05-95f3-63e712a2a96e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:29.982154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:29.982737 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:29.983014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:29.983284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:29.983918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:29.985528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:29.995860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1124/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:27:29.999915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:30.010289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc558-e69b-4202-b223-90dace83cc23 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:30.014833 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:30.015529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.015808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.016099 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] PATH_INFO: `/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae/users/73bf0d3bfbf245f58237828f9e13a861/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.031261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8e3b55f0043868c7da95fd8a032ae, user_id=73bf0d3bfbf245f58237828f9e13a861, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:30.034566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:30.046905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1088/2212] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:29 2022] PUT /identity/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae/users/73bf0d3bfbf245f58237828f9e13a861/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:30.050800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:30.060510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67bd9-ce3c-4344-933b-130b0db0a573 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:30.107037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:30.117408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:30.118010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.118294 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.118568 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.119206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:30.120839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf76ec-c068-4d11-83a2-b64acb1acc9a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:30.131006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1125/2213] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:27:30.135132 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:30.145935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ca3e-97e3-4aa5-8334-57bd78effc9c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:30.150612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c61721-be54-456f-a270-941139f54697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:30.151266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c61721-be54-456f-a270-941139f54697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.151568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c61721-be54-456f-a270-941139f54697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.151839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c61721-be54-456f-a270-941139f54697 admin admin] PATH_INFO: `/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae/users/73bf0d3bfbf245f58237828f9e13a861/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.153788 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c61721-be54-456f-a270-941139f54697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8e3b55f0043868c7da95fd8a032ae, user_id=73bf0d3bfbf245f58237828f9e13a861, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:30.156510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c61721-be54-456f-a270-941139f54697 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:30.166867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1089/2214] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:27:30 2022] PUT /identity/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae/users/73bf0d3bfbf245f58237828f9e13a861/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:27:30.177013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.177302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.177580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.206897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] MFA Rules not processed for user `73bf0d3bfbf245f58237828f9e13a861`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:30.208243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:30.278771 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1126/2215] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:30.290613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c61721-be54-456f-a270-941139f54697 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:30.292337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74c61721-be54-456f-a270-941139f54697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:30.353253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c61721-be54-456f-a270-941139f54697 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:30.356832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:30.357430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.357706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.357980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.367362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:30.368817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b581-9010-4675-8442-c3df30b37244 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:30.378595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1090/2216] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:30.451902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:30.462325 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4856d8-2dc0-46f9-9065-9d3f65b34f3e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:30.465959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:30.466554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:30.466832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:30.467103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:30.524736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:30.526153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661f18f-4044-4a76-892f-8d57c4c19bc5 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:30.535276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1127/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:27:35.166055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:35.166606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:35.166606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:35.186000 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] MFA Rules not processed for user `7f29a88591064a67bdb7644471beeb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:35.187215 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:35.244058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1091/2218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:40.530862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=67 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:45.237650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:56.812597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:56.813073 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:56.813168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:56.833732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:27:56.835076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:56.894946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1128/2219] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:27:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:27:56.940241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:27:56.941931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:27:57.028240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b989f-ee15-48cf-b97b-435c0df0d1fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:27:57.033996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:27:57.034605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:27:57.034897 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:27:57.035170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:27:57.044620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:27:57.046193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249b82-f3cb-4d23-8346-46eb021c0590 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:27:57.054174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1092/2220] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:28:01.321595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:01.395838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9abd5-caa9-4b54-b06e-5a481ef45239 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:01.401450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:01.402140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:01.402434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:01.402720 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] PATH_INFO: `/v3/users/4987e4d4d7d544ef8b1cd45b0e55da62` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:01.403870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4987e4d4d7d544ef8b1cd45b0e55da62)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:01.406019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:01.466837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4987e4d4d7d544ef8b1cd45b0e55da62'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:01.482202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4987e4d4d7d544ef8b1cd45b0e55da62'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:01.491989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4987e4d4d7d544ef8b1cd45b0e55da62'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:01.500849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4987e4d4d7d544ef8b1cd45b0e55da62'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:01.501578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4987e4d4d7d544ef8b1cd45b0e55da62'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:01.509415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1129/2221] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:01 2022] DELETE /identity/v3/users/4987e4d4d7d544ef8b1cd45b0e55da62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:28:01.514350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:01.515216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:01.515503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:01.538429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:01.540236 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:01.626496 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1093/2222] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:01.637899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:01.639406 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:01.671789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:01.708793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04384-63f6-49ef-8ff1-af27c2a390c2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:01.714483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:01.716010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:01.716296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:01.716603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:01.728594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:01.730104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:01.742689 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1130/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:02.082307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:02.084269 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:02.100859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1543a-7b7f-47e0-a395-b41ee4d4f77a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:02.107072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:02.107719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:02.108049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:02.108318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] PATH_INFO: `/v3/projects/4e5c99eba6f04a58aef1f461e4fb59ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:02.114672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5c99eba6f04a58aef1f461e4fb59ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:02.117623 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:02.186425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5c99eba6f04a58aef1f461e4fb59ff', 'request_id': 'req-83609795-3f12-48df-ac88-4fd36a64c746'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.195323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5c99eba6f04a58aef1f461e4fb59ff', 'request_id': 'req-83609795-3f12-48df-ac88-4fd36a64c746'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.202439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5c99eba6f04a58aef1f461e4fb59ff', 'request_id': 'req-83609795-3f12-48df-ac88-4fd36a64c746'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.215778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] The token cache is being invalidate because project 4e5c99eba6f04a58aef1f461e4fb59ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:02.216069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.216759 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.218850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1094/2224] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:02 2022] DELETE /identity/v3/projects/4e5c99eba6f04a58aef1f461e4fb59ff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:02.223982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:02.235258 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d300a6-e6d8-47ae-98e3-a72fbcaa1452 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:02.298957 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:02.300177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:02.300814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:02.301759 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] PATH_INFO: `/v3/users/73bf0d3bfbf245f58237828f9e13a861` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:02.303899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bf0d3bfbf245f58237828f9e13a861)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:02.307823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:02.365007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bf0d3bfbf245f58237828f9e13a861'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.380815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bf0d3bfbf245f58237828f9e13a861'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.388837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bf0d3bfbf245f58237828f9e13a861'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.399139 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bf0d3bfbf245f58237828f9e13a861'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.399886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-50ef1171-f23a-4d96-a5e9-c1fb8d0f1f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bf0d3bfbf245f58237828f9e13a861'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.406434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1131/2225] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:02 2022] DELETE /identity/v3/users/73bf0d3bfbf245f58237828f9e13a861 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:02.822016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:02.823605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:02.844304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83609795-3f12-48df-ac88-4fd36a64c746 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:02.863012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:02.926964 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:02.927613 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:02.927895 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:02.928167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] PATH_INFO: `/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:02.929328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb8e3b55f0043868c7da95fd8a032ae)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:02.931305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:02.984322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb8e3b55f0043868c7da95fd8a032ae', 'request_id': 'req-39a19615-d910-4b65-87eb-1be43442469c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:02.993760 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb8e3b55f0043868c7da95fd8a032ae', 'request_id': 'req-39a19615-d910-4b65-87eb-1be43442469c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:03.000483 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb8e3b55f0043868c7da95fd8a032ae', 'request_id': 'req-39a19615-d910-4b65-87eb-1be43442469c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:03.013507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] The token cache is being invalidate because project fdb8e3b55f0043868c7da95fd8a032ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:03.013801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:03.014450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39a19615-d910-4b65-87eb-1be43442469c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:03.016185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1095/2226] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:02 2022] DELETE /identity/v3/projects/fdb8e3b55f0043868c7da95fd8a032ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:03.021081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.021367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.021665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.042701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:03.043810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:03.088588 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:03.112893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1132/2227] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:03.120757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.121047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.121327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.142891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:03.144145 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:03.153313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1096/2228] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:28:03.158881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.171883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90fdd-b153-44aa-a0f5-6bf7107a4758 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.177469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.178729 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.178859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.179097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.179745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:28:03.180056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.181914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.196592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1133/2229] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:28:03.200915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.210360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b34ce-e225-4fb1-b9bb-ddd3de006c24 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.215737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.216472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.216834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.217180 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.217865 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.219880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.256976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1097/2230] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:03.262025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.273819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f550-98eb-491c-9551-7594fe8eff3f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.340535 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.341147 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.341435 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.341717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.342366 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.344293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.373103 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1134/2231] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:03.377615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.392750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932dcde-97af-475c-a37a-ba615b53926b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.418097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.419313 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.419935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.420293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.421093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.422855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.455447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1098/2232] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:28:03.475969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.513481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f603-fbb9-44eb-a0f8-5767c217d84c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.528487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.528487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.528487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.528487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.529033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.529033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44189a3-ad93-49c5-9317-4d5b7f119a0b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.543125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1135/2233] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:03.544414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.557512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcf91-a107-45d2-91b2-28c861589c63 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.563022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.563875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.564289 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.564796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] PATH_INFO: `/v3/projects/5db9164992ba47678368d0a3de17d2e7/users/22202c4fab72451b88303ca5bf0c8f1b/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.582717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9164992ba47678368d0a3de17d2e7, user_id=22202c4fab72451b88303ca5bf0c8f1b, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.586509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.615145 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1099/2234] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:03 2022] PUT /identity/v3/projects/5db9164992ba47678368d0a3de17d2e7/users/22202c4fab72451b88303ca5bf0c8f1b/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:03.627056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.627678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.627961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.659267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] MFA Rules not processed for user `22202c4fab72451b88303ca5bf0c8f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:03.660553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:03.743786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1136/2235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:03.748392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.805614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:03.825426 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830c9e-267e-4f34-8c1d-ea37514a536e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.833633 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.834384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.834773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.835149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.835886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.838227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:03.891419 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1100/2236] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:03.895667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:03.910034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28b7d4-98fd-4d18-a356-a60e000c0f29 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:03.965251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:03.992854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:03.994242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:03.994677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:03.995047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:03.995779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:03.998086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.029107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1137/2237] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:03 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:28:04.033554 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:04.047706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddd0d-328e-4b3c-8d98-682018a15e78 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:04.052866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:04.053481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.053764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.054040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.054692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:04.056293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.072082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1101/2238] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:04.073408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:04.085041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3469-d24c-4475-a92e-8dcc2ceb69d3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:04.089976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:04.090827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.091270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.091712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] PATH_INFO: `/v3/projects/890b352ed5df47ada4895fbb02a51873/users/4b6c8b2ed71f4c76b41aea5d95845d19/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.108641 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=890b352ed5df47ada4895fbb02a51873, user_id=4b6c8b2ed71f4c76b41aea5d95845d19, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:04.111442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.128199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1138/2239] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:04 2022] PUT /identity/v3/projects/890b352ed5df47ada4895fbb02a51873/users/4b6c8b2ed71f4c76b41aea5d95845d19/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:04.132305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:04.143963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaad1-e510-4a23-8d3f-88f6ef66beb3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:04.208194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:04.208893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.209175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.209446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.210083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:04.211683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9be12-b5f3-47dd-8465-63090e339e1c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.222691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1102/2240] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:28:04.226658 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:04.238201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfde465-7fe0-4251-bddb-5ba447462e5e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:04.243656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:04.244578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.245040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.245321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] PATH_INFO: `/v3/projects/890b352ed5df47ada4895fbb02a51873/users/4b6c8b2ed71f4c76b41aea5d95845d19/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.247279 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890b352ed5df47ada4895fbb02a51873, user_id=4b6c8b2ed71f4c76b41aea5d95845d19, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:04.250886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.263728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1139/2241] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:04 2022] PUT /identity/v3/projects/890b352ed5df47ada4895fbb02a51873/users/4b6c8b2ed71f4c76b41aea5d95845d19/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:04.274417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.274766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.275108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.306465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] MFA Rules not processed for user `4b6c8b2ed71f4c76b41aea5d95845d19`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:04.307847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:04.392641 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1103/2242] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:04.404576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:04.406505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:04.472361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52e67-fc4e-437d-aa88-576af0e180a2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:04.476445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:04.477107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:04.477387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:04.477659 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:04.540478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:04.542076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:04.552005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1140/2243] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:28:05.974761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:05.976232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:05.990930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4516a5-fc1b-47da-b997-a68e6e6b2bb7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:05.994939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:05.995592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:05.995868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:05.996345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:06.007328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:06.008996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6dbe-2198-4351-bd0a-8b2615a4a6dd service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:06.020839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1104/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:09.915469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:09.963223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:09.978448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd78-d9ca-4dbc-ac60-4f90cedd5083 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:09.982974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:09.983598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:09.983876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:09.984150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] PATH_INFO: `/v3/users/22202c4fab72451b88303ca5bf0c8f1b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:09.985289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=22202c4fab72451b88303ca5bf0c8f1b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:09.987855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:10.035713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22202c4fab72451b88303ca5bf0c8f1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.049583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22202c4fab72451b88303ca5bf0c8f1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.056559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22202c4fab72451b88303ca5bf0c8f1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.064210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22202c4fab72451b88303ca5bf0c8f1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.064885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22202c4fab72451b88303ca5bf0c8f1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.071135 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1141/2245] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:09 2022] DELETE /identity/v3/users/22202c4fab72451b88303ca5bf0c8f1b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:10.075304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:10.075830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:10.075830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:10.094703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:10.097124 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:10.114669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:10.158880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1105/2246] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:10.168943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:10.170332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:10.226054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25215df1-12cf-4741-b4fb-bc4fea452cfd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:10.229668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:10.230257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:10.230530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:10.230797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:10.240206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:10.241661 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:10.251017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1142/2247] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:10.529422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:10.530976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:10.545382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824665-c4b1-4b7f-9037-91791c7de52a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:10.550100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:10.550727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:10.551005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:10.551279 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] PATH_INFO: `/v3/projects/5db9164992ba47678368d0a3de17d2e7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:10.552425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db9164992ba47678368d0a3de17d2e7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:10.554371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:10.605322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db9164992ba47678368d0a3de17d2e7', 'request_id': 'req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.612751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db9164992ba47678368d0a3de17d2e7', 'request_id': 'req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.618357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db9164992ba47678368d0a3de17d2e7', 'request_id': 'req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.630899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] The token cache is being invalidate because project 5db9164992ba47678368d0a3de17d2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:10.631187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.631817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.633335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1106/2248] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:10 2022] DELETE /identity/v3/projects/5db9164992ba47678368d0a3de17d2e7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:10.637272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:10.647756 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53108-b73b-46ea-9181-605a8d015cc8 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:10.703175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:10.703805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:10.704088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:10.704367 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] PATH_INFO: `/v3/users/4b6c8b2ed71f4c76b41aea5d95845d19` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:10.706253 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6c8b2ed71f4c76b41aea5d95845d19)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:10.708170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:10.721540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:10.756344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6c8b2ed71f4c76b41aea5d95845d19'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.769963 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6c8b2ed71f4c76b41aea5d95845d19'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.777380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6c8b2ed71f4c76b41aea5d95845d19'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.785667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6c8b2ed71f4c76b41aea5d95845d19'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.787743 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-45ffa2f2-f4cd-4c36-8015-616bcdace94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6c8b2ed71f4c76b41aea5d95845d19'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:10.793238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1143/2249] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:10 2022] DELETE /identity/v3/users/4b6c8b2ed71f4c76b41aea5d95845d19 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:11.075482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.076954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:11.091243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783bf0-72b9-404b-9cf2-b34f5f2c52f2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.148222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.148814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.149098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.149371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] PATH_INFO: `/v3/projects/890b352ed5df47ada4895fbb02a51873` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.150479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890b352ed5df47ada4895fbb02a51873)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.152389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.198934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:11.200528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890b352ed5df47ada4895fbb02a51873', 'request_id': 'req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:11.210542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890b352ed5df47ada4895fbb02a51873', 'request_id': 'req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:11.217618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890b352ed5df47ada4895fbb02a51873', 'request_id': 'req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:11.230032 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] The token cache is being invalidate because project 890b352ed5df47ada4895fbb02a51873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:11.230322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:11.230989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-dec19ca2-21ed-4cd6-9c26-57c0a77e4668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:11.235912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1107/2250] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:11 2022] DELETE /identity/v3/projects/890b352ed5df47ada4895fbb02a51873 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:11.237777 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.238247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.238461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.261656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:11.262956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:11.339404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1144/2251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:11.347591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.348158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.348443 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.373537 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:11.374787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:11.383611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1108/2252] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:11.387657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.397417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a205-a94c-439d-ad24-cdce1baccabd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.402972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.403650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.404062 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.404664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.405248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:28:11.405646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.407337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.424707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1145/2253] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:28:11.428745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.438544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9f55-3506-491a-934d-ddc9441924ac None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.445110 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.445956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.446448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.446850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.447740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.450041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.491700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1109/2254] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:28:11.496109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.506106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a7c1-1a28-44bc-b47a-196abbc280c2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.568205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.568851 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.569152 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.569391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.570038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.571954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.600849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1146/2255] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:11.602185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.613899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17832119-03db-42f5-b7a4-683b31c4f924 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.619159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.619915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.620200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.620596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.621254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.622856 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.633299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1110/2256] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:11.637680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.648968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1393b6-152f-4b1b-847f-994aeee0b76a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.653905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.654504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.654783 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.655048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.655748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.657359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfe7b4-7b28-4fb9-9f4b-c3a895ae1c05 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.659332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:11.677032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1147/2257] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:11.678331 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.689722 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067cef1-9fc9-43d4-ae15-3d71229265d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.695326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.695988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.696277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.696587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] PATH_INFO: `/v3/projects/b8f287a24d414ac99c4891217ebd76dd/users/f8354b97dbf644688fc12d936ba8f30e/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.713596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f287a24d414ac99c4891217ebd76dd, user_id=f8354b97dbf644688fc12d936ba8f30e, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.716296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:11.733155 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1111/2258] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:11 2022] PUT /identity/v3/projects/b8f287a24d414ac99c4891217ebd76dd/users/f8354b97dbf644688fc12d936ba8f30e/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:11.802293 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.804065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.804065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.830854 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] MFA Rules not processed for user `f8354b97dbf644688fc12d936ba8f30e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:11.832056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:11.897016 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1148/2259] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:11.901499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:11.965956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4491f4-22e4-4806-8b53-12e1b5518e5b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:11.971999 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:11.972639 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:11.972920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:11.973186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:11.973831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:11.975711 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.002115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1112/2260] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:11 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:12.006287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.017886 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae34900-4b3c-493b-970a-239ac83b8b46 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.078614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.079268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.080666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.080666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.081229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.083536 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.106818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1149/2261] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:12 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:12.111326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.121779 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9c4b6-35b8-4c1f-9642-418417026508 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.127355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.127943 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.128221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.128521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.129158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.130761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.148390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1113/2262] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:28:12.152528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.163607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0caaa8-a9b4-4293-8897-691ab2211788 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.168572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.169240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.169519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.169791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] PATH_INFO: `/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3/users/3dd9b87250c2410eb9ce9e15c71c731d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.185768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c301edd27584a2ab5bbecea7df5e9d3, user_id=3dd9b87250c2410eb9ce9e15c71c731d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.188692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.201903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1150/2263] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:12 2022] PUT /identity/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3/users/3dd9b87250c2410eb9ce9e15c71c731d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:12.206126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.215978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fcb8-b122-4987-a903-176f6c6a3ef8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.263918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:12.281381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.283028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.283028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.283248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.283822 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.286012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb4e8b-8631-4afc-8896-5fab3a65b031 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.297523 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1114/2264] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:12.302892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.309764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269bd7-03d7-4fc6-bd47-666b75d5162c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.310047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269bd7-03d7-4fc6-bd47-666b75d5162c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.310317 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269bd7-03d7-4fc6-bd47-666b75d5162c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.311611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1115/2265] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 31 19:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 19:28:12.318136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad005-b22c-4507-bdc7-89826fc87abe admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.318335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.318335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.318335 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.322824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.323598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.323946 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.324285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] PATH_INFO: `/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3/users/3dd9b87250c2410eb9ce9e15c71c731d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.326375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c301edd27584a2ab5bbecea7df5e9d3, user_id=3dd9b87250c2410eb9ce9e15c71c731d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.329161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe3ef4-9e4e-444a-ba88-665370e6c433 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.338773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] MFA Rules not processed for user `b6a804b38ad04a8bb7045e397b4e1cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:12.340042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:12.340171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1151/2266] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:12 2022] PUT /identity/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3/users/3dd9b87250c2410eb9ce9e15c71c731d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:28:12.356611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.356992 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.357351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.387075 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] MFA Rules not processed for user `3dd9b87250c2410eb9ce9e15c71c731d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:12.388428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:12.418290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:12.419508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1116/2267] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 31 19:28:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:12.433083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.434533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:12.471126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1152/2268] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:28:12.481107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.482509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:12.508008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2085d76-4828-4e25-ac54-9ee05fec546e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.511748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.512385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.512735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.513012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.524592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.526025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.537909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1117/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:28:12.549876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069181e-bf0f-4ba8-a563-ef2d609a300a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.553519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.554122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.554407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.554683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.566269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.567706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17747967-2a0d-45e7-a2d1-e59c8615afa0 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.577444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1153/2270] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:28:12.691360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:12.700701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d98ca6-7556-4cea-a236-713ed30abc3a service glance] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:12.704905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:12.705965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:12.706252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:12.706524 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:12.764728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:12.766205 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:12.776673 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1118/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:14.330751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:14.331459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:14.331459 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:14.352672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:14.353888 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:14.416217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1154/2272] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:14.430499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:14.431963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:14.450906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:14.509702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48b613-08af-4585-8a63-40c1eadd7022 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:14.514813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:14.515409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:14.515738 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:14.516014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:14.525509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:14.527187 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c229ae-e0dd-47a5-800e-4dbec7dbb14b service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:14.538185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1119/2273] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:28:15.394510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:15.462601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d142878-ab71-49da-85bb-58a8085fdb31 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:15.467050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:15.467668 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:15.467943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:15.468216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] PATH_INFO: `/v3/users/f8354b97dbf644688fc12d936ba8f30e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:15.469365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8354b97dbf644688fc12d936ba8f30e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:15.471405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:15.484090 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:15.533809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8354b97dbf644688fc12d936ba8f30e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:15.546054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8354b97dbf644688fc12d936ba8f30e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:15.554646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8354b97dbf644688fc12d936ba8f30e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:15.562462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8354b97dbf644688fc12d936ba8f30e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:15.563328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8354b97dbf644688fc12d936ba8f30e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:15.578460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1155/2274] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:15 2022] DELETE /identity/v3/users/f8354b97dbf644688fc12d936ba8f30e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:15.584068 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:15.584590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:15.584687 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:15.607751 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:15.609393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:15.676267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1120/2275] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:15.686679 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:15.688102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:15.748827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d951c-c3d4-4e8c-a91b-4c520bf13a0c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:15.753057 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:15.753662 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:15.753939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:15.754209 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:15.764026 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:15.765855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:15.778290 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1156/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:28:16.118965 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:16.120747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:16.144400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976acab4-c6f2-4329-9226-20f41c6038e3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:16.150416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:16.151057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:16.151340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:16.151619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] PATH_INFO: `/v3/projects/b8f287a24d414ac99c4891217ebd76dd` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:16.152789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f287a24d414ac99c4891217ebd76dd)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:16.154713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:16.205542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f287a24d414ac99c4891217ebd76dd', 'request_id': 'req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.213900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f287a24d414ac99c4891217ebd76dd', 'request_id': 'req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.220344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f287a24d414ac99c4891217ebd76dd', 'request_id': 'req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.233649 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] The token cache is being invalidate because project b8f287a24d414ac99c4891217ebd76dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:16.233963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.234615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.237454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1121/2277] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:16 2022] DELETE /identity/v3/projects/b8f287a24d414ac99c4891217ebd76dd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:16.241587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:16.252823 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e06f4-f526-4e14-a9dd-55b5216b9cee service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:16.317672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:16.318538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:16.318882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:16.319227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] PATH_INFO: `/v3/users/3dd9b87250c2410eb9ce9e15c71c731d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:16.320431 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd9b87250c2410eb9ce9e15c71c731d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:16.322462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:16.361012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:16.371303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd9b87250c2410eb9ce9e15c71c731d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.383220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd9b87250c2410eb9ce9e15c71c731d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.390484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd9b87250c2410eb9ce9e15c71c731d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.400432 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd9b87250c2410eb9ce9e15c71c731d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.401741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2bace8fb-6b8d-4e21-8872-5bbc88d6a9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd9b87250c2410eb9ce9e15c71c731d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.413908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1157/2278] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:16 2022] DELETE /identity/v3/users/3dd9b87250c2410eb9ce9e15c71c731d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:16.719611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:16.721375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:16.756136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6e9a-24c8-4ff6-a5d3-6a68368bf747 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:16.805723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:16.857465 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:16.858235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:16.858683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:16.859037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] PATH_INFO: `/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:16.860332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c301edd27584a2ab5bbecea7df5e9d3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:16.863007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:16.923053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c301edd27584a2ab5bbecea7df5e9d3', 'request_id': 'req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.930489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c301edd27584a2ab5bbecea7df5e9d3', 'request_id': 'req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.935939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c301edd27584a2ab5bbecea7df5e9d3', 'request_id': 'req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.947910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] The token cache is being invalidate because project 7c301edd27584a2ab5bbecea7df5e9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:16.948351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.949221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-41cdfd93-550a-49c5-b0e8-e6a4d8e75b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:16.951077 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1122/2279] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:16 2022] DELETE /identity/v3/projects/7c301edd27584a2ab5bbecea7df5e9d3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:16.957733 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:16.958063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:16.958344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:16.979892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:16.981134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:17.045081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1158/2280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:17.053619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.053977 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.054323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.083714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:17.084975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:17.094053 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1123/2281] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:17.098792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.108966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308777ff-3122-4060-b09b-d370ee10e354 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.114611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.115242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.115522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.115796 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.116551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:28:17.116794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.118404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.131328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1159/2282] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:28:17.137409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.146896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe68644-c335-4cec-8182-cad1ddaf6c36 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.151540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.152134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.152408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.152705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.153482 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.155469 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.183720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1124/2283] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:28:17.188104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.198728 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467c0f-4c10-4551-80d9-89eb189197f9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.273770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.274470 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.274817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.275164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.275878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.277972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.301087 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1160/2284] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:17.305253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.315510 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61153-1a99-4414-b51e-3c9bb12befa6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.320348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.320957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.321235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.322118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.322821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.325137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.342349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1125/2285] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:17.343791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.356358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2704-0266-4760-9de0-47981e0aa60a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.361770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.362532 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.362813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.363086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.363797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.365623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347afdb2-871a-40ff-ba2d-d7be42f845e0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.380513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1161/2286] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:17.382937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.393638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658efe2b-2384-4e46-bc13-4e14b8e242b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.398223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.398876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.399151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.399454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] PATH_INFO: `/v3/projects/88c9cd21d18a462d8b6c6b5b47f50729/users/32b245f842ab48b38c052fabecc94b90/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.415732 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c9cd21d18a462d8b6c6b5b47f50729, user_id=32b245f842ab48b38c052fabecc94b90, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.418383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.433705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1126/2287] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:17 2022] PUT /identity/v3/projects/88c9cd21d18a462d8b6c6b5b47f50729/users/32b245f842ab48b38c052fabecc94b90/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:17.445749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.446322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.446322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.476444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] MFA Rules not processed for user `32b245f842ab48b38c052fabecc94b90`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:17.477715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:17.482705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:17.547039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1162/2288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:28:17.552055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.615841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:17.620780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8b48-21b8-40c3-b818-068cd8168628 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.627450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.628558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.629035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.629383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.630219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.632128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.666273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1127/2289] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:28:17.670652 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.683627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb340a1-f5cf-40be-a42b-f94d6b38807a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.747601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.748312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.748699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.748975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.749919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.752503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.795027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1163/2290] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:28:17 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:28:17.799814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.810369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e006-79c6-44b6-8a9c-7bf358ddb28a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.815298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.815893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.816226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.816541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.817184 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.818813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.829991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1128/2291] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:28:17.834050 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.844136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9bbf-aae4-4600-b6eb-7a9178182e6e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.849407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.850220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.850339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.850572 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] PATH_INFO: `/v3/projects/c5edb139c79542f38221b4d6d46a50fc/users/03fdc763b0ff42b38238b9af1e1629df/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.866647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5edb139c79542f38221b4d6d46a50fc, user_id=03fdc763b0ff42b38238b9af1e1629df, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.869369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.885574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1164/2292] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:17 2022] PUT /identity/v3/projects/c5edb139c79542f38221b4d6d46a50fc/users/03fdc763b0ff42b38238b9af1e1629df/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:17.890164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.902938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510568-64a4-4d00-9af7-af2cfa53dc94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.961522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.962127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.962407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.962677 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:17.963309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:17.964926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931620c-4be2-4475-a180-dd70445a51ae admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:17.977204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1129/2293] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:28:17.981427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:17.992981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5073-7d55-4d21-96ea-8b93c6705dc7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:17.998704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:17.999407 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:17.999684 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:17.999959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] PATH_INFO: `/v3/projects/c5edb139c79542f38221b4d6d46a50fc/users/03fdc763b0ff42b38238b9af1e1629df/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:18.002013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5edb139c79542f38221b4d6d46a50fc, user_id=03fdc763b0ff42b38238b9af1e1629df, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:18.005284 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:18.023460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1165/2294] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:28:17 2022] PUT /identity/v3/projects/c5edb139c79542f38221b4d6d46a50fc/users/03fdc763b0ff42b38238b9af1e1629df/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:28:18.030154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:18.030449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:18.030712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:18.083857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] MFA Rules not processed for user `03fdc763b0ff42b38238b9af1e1629df`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:18.086037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:18.190780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1130/2295] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:28:18.201820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:18.203487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:18.269766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9e7a-0eb4-4896-8974-a352f5984cb3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:18.275468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:18.276167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:18.276444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:18.276829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:18.287848 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:18.289586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:18.300971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1166/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:18.395978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:18.407128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9da302-1b3d-49ce-8f10-76ab0c689c71 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:18.414953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:18.415590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:18.415868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:18.416139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:18.481528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:18.493901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:18.495477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726847d3-7b43-4ecd-aab4-a806c49a9756 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:18.506280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1131/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:23.564093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:23.568437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:23.632938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecdc2b-5c45-401c-b700-91b6b5ded30e service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:23.637418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:23.638051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:23.638333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:23.638610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] PATH_INFO: `/v3/users/32b245f842ab48b38c052fabecc94b90` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:23.639741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b245f842ab48b38c052fabecc94b90)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:23.641829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:23.688770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b245f842ab48b38c052fabecc94b90'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:23.700525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b245f842ab48b38c052fabecc94b90'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:23.708142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b245f842ab48b38c052fabecc94b90'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:23.719356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b245f842ab48b38c052fabecc94b90'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:23.720711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b245f842ab48b38c052fabecc94b90'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:23.736573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1167/2298] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:23 2022] DELETE /identity/v3/users/32b245f842ab48b38c052fabecc94b90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:28:23.738274 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:23.738762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:23.738871 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:23.761337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:23.762986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:23.830699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1132/2299] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:28:23.841104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:23.842745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:23.905723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c44f94-28e9-47a9-b4a4-47cd6d7f0c92 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:23.910017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:23.910623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:23.910902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:23.911176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:23.920249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:23.921715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:23.931270 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1168/2300] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:24.214841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:24.216627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:24.243193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fe9ab-c9cb-44ac-b19a-f5ce1f248c54 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:24.247888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:24.248566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:24.248867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:24.249160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] PATH_INFO: `/v3/projects/88c9cd21d18a462d8b6c6b5b47f50729` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:24.250312 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c9cd21d18a462d8b6c6b5b47f50729)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:24.252956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:24.302772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c9cd21d18a462d8b6c6b5b47f50729', 'request_id': 'req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.310102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c9cd21d18a462d8b6c6b5b47f50729', 'request_id': 'req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.315698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c9cd21d18a462d8b6c6b5b47f50729', 'request_id': 'req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.326646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] The token cache is being invalidate because project 88c9cd21d18a462d8b6c6b5b47f50729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:24.326931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.327559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.329400 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1133/2301] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:24 2022] DELETE /identity/v3/projects/88c9cd21d18a462d8b6c6b5b47f50729 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:24.333964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:24.359675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d1ebd-33a6-43ba-9cca-96badee9f5ea service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:24.385260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:24.432200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:24.432769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:24.433102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:24.433377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] PATH_INFO: `/v3/users/03fdc763b0ff42b38238b9af1e1629df` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:24.434556 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fdc763b0ff42b38238b9af1e1629df)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:24.436580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:24.490190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fdc763b0ff42b38238b9af1e1629df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.506097 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fdc763b0ff42b38238b9af1e1629df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.514501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fdc763b0ff42b38238b9af1e1629df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.524976 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fdc763b0ff42b38238b9af1e1629df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.525809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17f9bfcf-d2d8-4986-b39e-c6ae37a7b9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fdc763b0ff42b38238b9af1e1629df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:24.535994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1169/2302] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:24 2022] DELETE /identity/v3/users/03fdc763b0ff42b38238b9af1e1629df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:24.903498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:24.905232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:24.921724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b412b-3b6a-4fb9-a0c6-69a4deb538bc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:24.986079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:24.986730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:24.987025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:24.987306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] PATH_INFO: `/v3/projects/c5edb139c79542f38221b4d6d46a50fc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:24.988425 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5edb139c79542f38221b4d6d46a50fc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:24.990427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:25.007199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:25.046752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5edb139c79542f38221b4d6d46a50fc', 'request_id': 'req-1e1acc4c-90fd-4bac-a5fa-625c03d79968'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:25.055281 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5edb139c79542f38221b4d6d46a50fc', 'request_id': 'req-1e1acc4c-90fd-4bac-a5fa-625c03d79968'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:25.061681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5edb139c79542f38221b4d6d46a50fc', 'request_id': 'req-1e1acc4c-90fd-4bac-a5fa-625c03d79968'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:25.073356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] The token cache is being invalidate because project c5edb139c79542f38221b4d6d46a50fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:25.073646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:25.074293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:25.075768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1134/2303] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:24 2022] DELETE /identity/v3/projects/c5edb139c79542f38221b4d6d46a50fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:34.528881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:35.070209 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:35.590244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:35.590741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:35.590863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:35.611385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:28:35.612541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:35.666245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1170/2304] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:28:35.679164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:35.680612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:35.748712 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1acc4c-90fd-4bac-a5fa-625c03d79968 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:35.753796 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:35.754390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:35.754666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:35.754936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:35.762829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:35.764419 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:35.773608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1135/2305] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:28:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:28:45.659112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=25 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:45.769684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=32 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:47.203598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:47.205549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:47.288690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84e3c8-c75c-40a5-8609-89d7c606f46f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:47.292655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:47.293260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:47.293538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:47.293809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:47.295531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:47.366442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:47.367885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:47.376760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1171/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:52.237835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:52.239255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:52.260547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f757-d500-4e6c-b6b5-96bdf602bcb8 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:52.264114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:52.264728 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:52.265005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:52.265296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:52.266983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:52.359591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:52.361130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:52.379525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1136/2307] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:55.287690 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:55.290540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:55.415980 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:55.432598 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e980f-cf4b-41a7-b937-cbeb2e8042f7 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:55.437868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:55.438474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:55.438751 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:55.439646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:55.441478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:55.454134 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:55.455797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:55.466615 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1172/2308] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:28:59.183382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:59.184843 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:59.197652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb04ce-0029-4d31-9d7c-26ab54c9690e service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:59.202297 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:59.202953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:59.203234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:59.203507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] PATH_INFO: `/v3/users/97ef071a7fcb4ac397be8a332cd7eddf` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:59.205212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ef071a7fcb4ac397be8a332cd7eddf)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:59.207261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:59.253828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ef071a7fcb4ac397be8a332cd7eddf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.261298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ef071a7fcb4ac397be8a332cd7eddf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.274028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ef071a7fcb4ac397be8a332cd7eddf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.274719 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ef071a7fcb4ac397be8a332cd7eddf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.282063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ef071a7fcb4ac397be8a332cd7eddf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.289349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1137/2309] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:59 2022] DELETE /identity/v3/users/97ef071a7fcb4ac397be8a332cd7eddf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:59.460497 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:59.471300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bdd30-4563-45a4-a5e2-856cea01f3ca service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:59.535858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:59.536528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:59.536956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:59.537229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] PATH_INFO: `/v3/projects/408aa96a5b2f409dba8bd3f37b14d12a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:59.538370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408aa96a5b2f409dba8bd3f37b14d12a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:59.540589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:59.593793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408aa96a5b2f409dba8bd3f37b14d12a', 'request_id': 'req-4393712b-839e-4c3b-8b7a-7903f810c511'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.601666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408aa96a5b2f409dba8bd3f37b14d12a', 'request_id': 'req-4393712b-839e-4c3b-8b7a-7903f810c511'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.609071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408aa96a5b2f409dba8bd3f37b14d12a', 'request_id': 'req-4393712b-839e-4c3b-8b7a-7903f810c511'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.619970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] The token cache is being invalidate because project 408aa96a5b2f409dba8bd3f37b14d12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:28:59.620280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.620952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.622437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1173/2310] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:59 2022] DELETE /identity/v3/projects/408aa96a5b2f409dba8bd3f37b14d12a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:59.626920 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:59.628405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:59.641558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cd0e1-3868-4ee3-807e-270c073cfeba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:28:59.659309 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:59.702219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:28:59.702847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:28:59.703127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:28:59.703402 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] PATH_INFO: `/v3/users/814b829a052f43959efb05a29a7e0cca` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:28:59.705139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814b829a052f43959efb05a29a7e0cca)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:28:59.707071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:28:59.752772 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814b829a052f43959efb05a29a7e0cca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.759498 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814b829a052f43959efb05a29a7e0cca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.771455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814b829a052f43959efb05a29a7e0cca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.772149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814b829a052f43959efb05a29a7e0cca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.779911 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814b829a052f43959efb05a29a7e0cca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:28:59.786168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1138/2311] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:28:59 2022] DELETE /identity/v3/users/814b829a052f43959efb05a29a7e0cca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:28:59.956892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:28:59.958443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:28:59.972397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393712b-839e-4c3b-8b7a-7903f810c511 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:00.029458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:00.030084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:00.030365 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:00.030642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] PATH_INFO: `/v3/projects/1a7785d69a7942d689112cb593726d89` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:00.031750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7785d69a7942d689112cb593726d89)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:00.034049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:00.050229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:00.081176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7785d69a7942d689112cb593726d89', 'request_id': 'req-008c9c4b-c009-414f-8d18-7975b613bf73'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:00.087993 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7785d69a7942d689112cb593726d89', 'request_id': 'req-008c9c4b-c009-414f-8d18-7975b613bf73'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:00.094102 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7785d69a7942d689112cb593726d89', 'request_id': 'req-008c9c4b-c009-414f-8d18-7975b613bf73'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:00.105004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] The token cache is being invalidate because project 1a7785d69a7942d689112cb593726d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:00.105295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:00.105932 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:00.107393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1174/2312] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:28:59 2022] DELETE /identity/v3/projects/1a7785d69a7942d689112cb593726d89 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:09.782463 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:10.102065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:24.871972 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:24.873378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:24.951173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff233-992c-4a48-b4a5-15a054935787 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:24.999380 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:24.999980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:25.000286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:25.000592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:25.002302 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:25.066038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:25.067481 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:25.076975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1139/2313] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:28.254824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:28.256241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:28.273500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c9c4b-c009-414f-8d18-7975b613bf73 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:28.278394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:28.279048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.279376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.279654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] PATH_INFO: `/v3/users/7f29a88591064a67bdb7644471beeb24` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.280867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f29a88591064a67bdb7644471beeb24)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:28.282839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:28.334651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f29a88591064a67bdb7644471beeb24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.350620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f29a88591064a67bdb7644471beeb24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.357610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f29a88591064a67bdb7644471beeb24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.366063 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f29a88591064a67bdb7644471beeb24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.366804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4406b3c8-c002-4524-b5f3-acd8e9d222f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f29a88591064a67bdb7644471beeb24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.373047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1175/2314] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:28 2022] DELETE /identity/v3/users/7f29a88591064a67bdb7644471beeb24 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:28.547011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:28.559683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663515-9e96-42c6-af2d-8dc2bfb6ec49 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:28.607057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:28.621480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:28.622143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.622424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.622698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] PATH_INFO: `/v3/projects/a185558eaa494884960bd5fb9102a736` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.623805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a185558eaa494884960bd5fb9102a736)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:28.625768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:28.673217 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a185558eaa494884960bd5fb9102a736', 'request_id': 'req-1157f9f0-5599-4c6f-8d3f-6caebfee6603'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.681295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a185558eaa494884960bd5fb9102a736', 'request_id': 'req-1157f9f0-5599-4c6f-8d3f-6caebfee6603'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.687065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a185558eaa494884960bd5fb9102a736', 'request_id': 'req-1157f9f0-5599-4c6f-8d3f-6caebfee6603'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.698410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] The token cache is being invalidate because project a185558eaa494884960bd5fb9102a736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:28.698698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.699324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1157f9f0-5599-4c6f-8d3f-6caebfee6603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:28.700836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1140/2315] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:28 2022] DELETE /identity/v3/projects/a185558eaa494884960bd5fb9102a736 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:28.706377 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e342-89ea-434c-ab38-db7503515824 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.706672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e342-89ea-434c-ab38-db7503515824 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.707006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e342-89ea-434c-ab38-db7503515824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.765709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b322e342-89ea-434c-ab38-db7503515824 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:28.766827 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b322e342-89ea-434c-ab38-db7503515824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:28.828399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1176/2316] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:28.836203 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.836512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.836787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.856878 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:28.858072 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:28.866467 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1141/2317] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:28.870657 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322e342-89ea-434c-ab38-db7503515824 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:28.880444 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322e342-89ea-434c-ab38-db7503515824 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:28.885048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:28.885646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.885926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.886202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.886850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:29:28.887156 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:28.888776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:28.900204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1177/2318] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:29:28.904351 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:28.914978 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd8e9-6f08-4b2c-b2e2-a07b0539e2c1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:28.920234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:28.920852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:28.921127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:28.921393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:28.922013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:28.923900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:28.952210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1142/2319] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:28 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:28.957167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:28.967114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c4b2-70df-462e-b687-9939930a57b7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:28.993855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:29.026601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.027133 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.027414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.027687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.028312 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.030249 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.051398 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1178/2320] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:28 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:29:29.055592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.065891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5a56-b5c1-4200-8ebb-67e7395d57e8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.070444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.071024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.071298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.071571 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.072202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.073827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.084540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1143/2321] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:29.088392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.098908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee61c46-be78-4ca9-9e53-a6cecbcc78a4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.103437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.104022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.104300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.104614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.105251 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.107320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5f7d-d122-4db7-a995-3a4563daebdd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.118403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1179/2322] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:29.122501 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.132286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e56c8f-ef8b-418f-bee0-07024336bfbd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.136828 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.137460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.137737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.138009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] PATH_INFO: `/v3/projects/689aa72d17ba47c09123e0fe1cdfea3a/users/b5e12e24554d4592a22685cc24798e48/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.152898 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689aa72d17ba47c09123e0fe1cdfea3a, user_id=b5e12e24554d4592a22685cc24798e48, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.155528 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.170407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1144/2323] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:29 2022] PUT /identity/v3/projects/689aa72d17ba47c09123e0fe1cdfea3a/users/b5e12e24554d4592a22685cc24798e48/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:29.180806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.181093 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.181364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.209241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] MFA Rules not processed for user `b5e12e24554d4592a22685cc24798e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:29.210430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:29.273839 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1180/2324] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:29.279579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.341903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34426-4490-46c4-ab9b-859fab9cbd96 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.346801 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.347446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.347768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.348042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.348714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.350727 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.370336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:29.380189 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1145/2325] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:29 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:29.384245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.395427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f83e7-6360-47e8-8360-98d6cc15b4bf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.451507 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.452104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.452379 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.452681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.453303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.455235 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.475885 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1181/2326] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:29 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:29.479734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.491265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47043516-846f-4606-ae54-0e12944b1b91 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.496167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.497069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.497446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.497757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.498682 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.500525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.511417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1146/2327] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:29.516758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.527682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999db028-81a8-47fd-bcdd-fb24039440e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.532816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.533994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.534268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.534541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] PATH_INFO: `/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc/users/fe2bfc8259ea4713a24d93621397ba96/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.551918 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e99e85d0d94ed191fb7bcd97bc53cc, user_id=fe2bfc8259ea4713a24d93621397ba96, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.554665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.568450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1182/2328] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:29 2022] PUT /identity/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc/users/fe2bfc8259ea4713a24d93621397ba96/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:29.572508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.587570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f31e-6ca1-4165-9055-21268c9591de admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.649239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.649850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.650158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.650433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.651076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.652757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5270e6-ec61-4144-a0d8-09ca0d926844 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.663475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1147/2329] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:29.667936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.673479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:29.680195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eca9fe-0f85-4189-a732-ca3a74b2943d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.685369 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.686033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.686329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.686604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] PATH_INFO: `/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc/users/fe2bfc8259ea4713a24d93621397ba96/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.688629 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e99e85d0d94ed191fb7bcd97bc53cc, user_id=fe2bfc8259ea4713a24d93621397ba96, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.691882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.702287 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1183/2330] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:29 2022] PUT /identity/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc/users/fe2bfc8259ea4713a24d93621397ba96/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:29.715283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.715628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.715913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.744398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] MFA Rules not processed for user `fe2bfc8259ea4713a24d93621397ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:29.745808 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:29.814545 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1148/2331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:29.825081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:29.826832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:29.904997 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6caec-ac3d-4235-acfe-c26eeaeb1534 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:29.908734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:29.909402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:29.909680 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:29.909952 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:29.965688 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:29.967113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:29.976065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1184/2332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:32.537954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:32.547931 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b1687-0c61-4ee6-81b9-274eaa957695 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:32.553153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:32.553763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:32.554047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:32.554386 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:32.563890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:32.565651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:32.575909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1149/2333] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:39.047901 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:39.048269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:39.112571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60da9e-5de7-47e9-aa6a-de24aced6853 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:39.116484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:39.117107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:39.117385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:39.117656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:39.119388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:39.158797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:39.183698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:39.185151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:39.195158 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1185/2334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:42.520698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:42.522362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:42.537836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455debb8-a0cb-46fe-9c27-636dba82e836 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:42.543527 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:42.544238 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:42.544561 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:42.544841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] PATH_INFO: `/v3/users/f3bb55041a374035ad251e7706a144c2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:42.545967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bb55041a374035ad251e7706a144c2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:42.547918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:42.601570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bb55041a374035ad251e7706a144c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:42.603818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:42.610448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bb55041a374035ad251e7706a144c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:42.628153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bb55041a374035ad251e7706a144c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:42.628837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bb55041a374035ad251e7706a144c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:42.638111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7bc46ded-fa09-4d70-a8bb-b74331c2e777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bb55041a374035ad251e7706a144c2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:42.644785 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1150/2335] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:42 2022] DELETE /identity/v3/users/f3bb55041a374035ad251e7706a144c2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:42.853489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:42.873791 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0256-58c7-4387-9efc-80693c6e25b3 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:42.951455 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:42.952272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:42.952674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:42.953088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] PATH_INFO: `/v3/projects/9d912a1d90174a96b8551a65f23ec776` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:42.955203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d912a1d90174a96b8551a65f23ec776)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:42.957604 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.014914 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d912a1d90174a96b8551a65f23ec776', 'request_id': 'req-94087ad6-d169-4996-b4c4-0b28b1b24154'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:43.022663 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d912a1d90174a96b8551a65f23ec776', 'request_id': 'req-94087ad6-d169-4996-b4c4-0b28b1b24154'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:43.029519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d912a1d90174a96b8551a65f23ec776', 'request_id': 'req-94087ad6-d169-4996-b4c4-0b28b1b24154'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:43.044034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] The token cache is being invalidate because project 9d912a1d90174a96b8551a65f23ec776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:43.044332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:43.045039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-94087ad6-d169-4996-b4c4-0b28b1b24154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:43.048502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1186/2336] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:42 2022] DELETE /identity/v3/projects/9d912a1d90174a96b8551a65f23ec776 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:43.051815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.052415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.053405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.079538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:43.080762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:43.152515 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1151/2337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:29:43.159468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.159761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.160380 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.184113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:43.185373 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:43.197269 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1187/2338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:43.198166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.211536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a030908-2f2b-4eb2-9978-5eed7342dfab None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.219570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.220191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.220681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.220957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.221634 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:29:43.223308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.225541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.241004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1152/2339] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:29:43.245660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.256739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8e16a-f307-42e9-ae56-847e53758c8c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.268894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.269148 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.269461 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.269719 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.270584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.273099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.304681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1188/2340] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:43 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:29:43.308980 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.319996 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db50b3-fbec-414d-ab15-66b925ee99c7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.377133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.377744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.378019 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.378286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.378915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.380896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.404586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1153/2341] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:43.406813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.418595 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1187da-82ab-43bf-aee9-e64d343a2c7c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.423201 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.423797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.424071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.424342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.425007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.426590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.440107 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1189/2342] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:29:43.441382 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.451963 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3f3d-0c7a-4824-adc5-a59f75541774 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.456568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.457160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.457437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.457706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.458340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.460720 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae2a07-a56d-4243-accb-005c89d8b3d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.474476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1154/2343] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:43.475755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.485831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b79e3-1431-436a-ac75-4460122876c6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.490518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.491163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.491439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.491722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] PATH_INFO: `/v3/projects/bd38188a9de34acf92b0738ab24fb2d7/users/381fb95cc82c425aa2df1e97057cdfd9/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.507638 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd38188a9de34acf92b0738ab24fb2d7, user_id=381fb95cc82c425aa2df1e97057cdfd9, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.510354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.519301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:43.525323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1190/2344] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:43 2022] PUT /identity/v3/projects/bd38188a9de34acf92b0738ab24fb2d7/users/381fb95cc82c425aa2df1e97057cdfd9/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:43.530181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.530718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.531086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.553934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:43.555151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:43.592816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:43.632039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1155/2345] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:29:43.642865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:43.646925 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:43.718818 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f88505-780f-441f-aa58-c3de1806749b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:43.724193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:43.724897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:43.725210 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:43.725514 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:43.736113 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:43.737607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c11a0b-3bbe-4fc5-9605-c7240570bc1c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:43.749052 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1191/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:29:45.475663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:45.479258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:45.494369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcae22-a518-4b62-9c40-474f52f8fe43 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:45.500567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:45.501874 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:45.502532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:45.503126 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] PATH_INFO: `/v3/users/b5e12e24554d4592a22685cc24798e48` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:45.505852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e12e24554d4592a22685cc24798e48)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:45.508792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:45.598823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e12e24554d4592a22685cc24798e48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:45.607938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e12e24554d4592a22685cc24798e48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:45.621604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e12e24554d4592a22685cc24798e48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:45.622340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e12e24554d4592a22685cc24798e48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:45.631246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e12e24554d4592a22685cc24798e48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:45.638995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1156/2347] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:45 2022] DELETE /identity/v3/users/b5e12e24554d4592a22685cc24798e48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:45.644089 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:45.644605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:45.644887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:45.667892 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:45.669283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:45.751112 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1192/2348] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:45.769680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:45.772208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:45.839771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6f11-88a0-4937-86da-1a89d9681c16 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:45.845163 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:45.845790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:45.846103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:45.846366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:45.860951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:45.862415 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:45.873376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1157/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:46.149110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:46.150541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:46.165592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216bee8-6953-4b81-9938-25ae98ad4e05 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:46.177078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:46.177758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:46.178033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:46.180850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] PATH_INFO: `/v3/projects/689aa72d17ba47c09123e0fe1cdfea3a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:46.182714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689aa72d17ba47c09123e0fe1cdfea3a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:46.185255 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:46.243584 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689aa72d17ba47c09123e0fe1cdfea3a', 'request_id': 'req-37b57b7e-8a60-4bc7-8f50-d9308e514623'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.253069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689aa72d17ba47c09123e0fe1cdfea3a', 'request_id': 'req-37b57b7e-8a60-4bc7-8f50-d9308e514623'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.261754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689aa72d17ba47c09123e0fe1cdfea3a', 'request_id': 'req-37b57b7e-8a60-4bc7-8f50-d9308e514623'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.273831 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] The token cache is being invalidate because project 689aa72d17ba47c09123e0fe1cdfea3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:46.274223 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.274960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.279389 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1193/2350] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:46 2022] DELETE /identity/v3/projects/689aa72d17ba47c09123e0fe1cdfea3a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:46.280782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:46.292389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fad6a-1767-41f6-a13c-3cddf5d31614 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:46.351169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:46.367910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:46.368664 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:46.369009 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:46.369393 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] PATH_INFO: `/v3/users/fe2bfc8259ea4713a24d93621397ba96` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:46.370757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2bfc8259ea4713a24d93621397ba96)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:46.372818 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:46.431105 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2bfc8259ea4713a24d93621397ba96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.440812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2bfc8259ea4713a24d93621397ba96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.455620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2bfc8259ea4713a24d93621397ba96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.456434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2bfc8259ea4713a24d93621397ba96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.469916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cba50213-6ec2-4b9b-ac03-18423020a205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2bfc8259ea4713a24d93621397ba96'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:46.478398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1158/2351] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:46 2022] DELETE /identity/v3/users/fe2bfc8259ea4713a24d93621397ba96 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:47.013566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.016375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:47.042437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57b7e-8a60-4bc7-8f50-d9308e514623 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.082931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:47.157404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.158363 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.158882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.159322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] PATH_INFO: `/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.161397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e99e85d0d94ed191fb7bcd97bc53cc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.165534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.235936 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e99e85d0d94ed191fb7bcd97bc53cc', 'request_id': 'req-0fa8117d-a1c8-49aa-af68-97826d49629d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:47.247244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e99e85d0d94ed191fb7bcd97bc53cc', 'request_id': 'req-0fa8117d-a1c8-49aa-af68-97826d49629d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:47.257144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e99e85d0d94ed191fb7bcd97bc53cc', 'request_id': 'req-0fa8117d-a1c8-49aa-af68-97826d49629d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:47.271872 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] The token cache is being invalidate because project 36e99e85d0d94ed191fb7bcd97bc53cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:47.272489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:47.273358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0fa8117d-a1c8-49aa-af68-97826d49629d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:47.275136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1194/2352] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:47 2022] DELETE /identity/v3/projects/36e99e85d0d94ed191fb7bcd97bc53cc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:47.279834 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.280192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.280579 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.304284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:47.305848 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:47.380685 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1159/2353] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:47.386583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.386583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.386583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.409551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:47.410919 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:47.420624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1195/2354] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:47.424246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.436474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b96e7-8d80-48e0-a1ae-873ac1633490 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.441583 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.442699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.443142 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.443587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.444377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:29:47.444826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.446591 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.460599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1160/2355] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:29:47.465076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.475220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edaced-9de7-45eb-9e89-4be1179c18d1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.481004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.481879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.482812 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.483166 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.484035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.486150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.524439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1196/2356] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:47 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:29:47.528319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.543461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7068d-406e-4825-b9fe-e85a80a900fc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.684407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:47.696904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.697826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.698279 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.698741 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.699371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.702319 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.730535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1161/2357] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:47 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:47.734784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.750275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eabed-5f7c-44b5-8726-52994b6e812d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.756529 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.757654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.757947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.758224 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.758860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.761115 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.779905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.795302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1197/2358] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:47.800211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cc97-5987-43db-8d28-bdae84391f76 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.807424 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.808119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.809876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.810261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.811022 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.812782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e1d8f-a3c4-43e3-8587-eca996d12f10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.831424 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:47.837703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1162/2359] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:47.843655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab2fc-8d18-44e4-a86f-6dc6dc19b612 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:47.851654 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:47.852374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.853047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.853047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] PATH_INFO: `/v3/projects/810426dcef57434981144a95a19bb237/users/8822c46ad36940fc81e33284c113989d/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.877909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] RBAC: Authorizing `identity:create_grant(project_id=810426dcef57434981144a95a19bb237, user_id=8822c46ad36940fc81e33284c113989d, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:47.881430 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:47.900528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1198/2360] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:47 2022] PUT /identity/v3/projects/810426dcef57434981144a95a19bb237/users/8822c46ad36940fc81e33284c113989d/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:47.909154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:47.909536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:47.909903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:47.939826 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] MFA Rules not processed for user `8822c46ad36940fc81e33284c113989d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:47.941244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:48.050806 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1163/2361] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:48.056242 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.125217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:48.139058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3faaf-01cb-480b-8a72-475e1810573f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.146169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.147776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.147776 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.148006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.148704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.150931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.187580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1199/2362] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:48 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:48.188827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.201162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672022b9-d72d-427e-85c8-f69711a1c67b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.279957 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.280777 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.281160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.281536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.282326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.284735 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.320139 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1164/2363] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:48 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:48.324082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.335954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26805-d0bb-4fdf-a1b4-6e1af81a1f91 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.342722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.343349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.343626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.344191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.344983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.346711 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.359172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1200/2364] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:48.364364 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.395093 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713abf-be8f-48cb-844f-2eb9e6fe6191 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.411499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.413707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.414284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.414652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] PATH_INFO: `/v3/projects/40680bd45c644d3696e5b13e76aa53b7/users/f4099af4b3e2493683fe609c22a39c56/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.444819 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40680bd45c644d3696e5b13e76aa53b7, user_id=f4099af4b3e2493683fe609c22a39c56, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.450391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624ad34-f2b9-485f-8ed4-7b18bb751805 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.470698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1165/2365] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:48 2022] PUT /identity/v3/projects/40680bd45c644d3696e5b13e76aa53b7/users/f4099af4b3e2493683fe609c22a39c56/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:48.474735 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.492267 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a821d-ac53-4183-90c2-430be105a652 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.562553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.563122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.563430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.586198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.586822 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.587101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.587376 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.588033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.589673 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.598007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] MFA Rules not processed for user `381fb95cc82c425aa2df1e97057cdfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:48.599615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:48.600697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1201/2366] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:48.604723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.615356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec5c3-4a3f-4e34-806e-492037941c7f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.623198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.623868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.624217 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.624408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] PATH_INFO: `/v3/projects/40680bd45c644d3696e5b13e76aa53b7/users/f4099af4b3e2493683fe609c22a39c56/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.635035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40680bd45c644d3696e5b13e76aa53b7, user_id=f4099af4b3e2493683fe609c22a39c56, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.635534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:48.635730 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bfd38-8aae-4c65-97e5-ce23a17dcff5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.662924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1202/2367] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:48 2022] PUT /identity/v3/projects/40680bd45c644d3696e5b13e76aa53b7/users/f4099af4b3e2493683fe609c22a39c56/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:29:48.673066 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.673356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.673640 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.709505 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] MFA Rules not processed for user `f4099af4b3e2493683fe609c22a39c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:48.710744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:48.715748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1166/2368] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:29:48.731926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.733518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:48.810006 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1203/2369] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:29:48.819460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:48.823092 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:48.878793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dfeb8-9c8e-46f3-8fa9-4f63fa9c44b6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.883064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:48.911257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99081c-153e-4597-bf3b-6a09dc03a31d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:48.917368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.918596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.919540 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.920309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:48.933145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:48.935207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:48.958034 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1204/2370] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:48.967405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:48.968108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:48.968535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:48.968892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:49.016447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:49.022047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:49.023907 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:49.036959 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c7590-17fe-4d44-8e10-2e62e44a00cf service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:49.043554 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:49.044182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:49.044487 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:49.045206 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:49.061708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:49.063436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab8a1-1644-4e77-a2f7-61de5f848387 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:49.075835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1167/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:29:49.116508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:49.117947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:49.131254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1205/2372] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:50.595183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0b4f-36cf-42b5-818d-70c974ef0025 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:50.595705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0b4f-36cf-42b5-818d-70c974ef0025 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:50.595705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0b4f-36cf-42b5-818d-70c974ef0025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:50.627570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0c2f0b4f-36cf-42b5-818d-70c974ef0025 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:50.629075 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0c2f0b4f-36cf-42b5-818d-70c974ef0025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:50.701763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1168/2373] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:50.770581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:50.778204 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:50.881829 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9945-5d20-4d12-ac52-802306695860 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:50.890571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:50.892451 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:50.892938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:50.893990 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:50.915603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:50.917889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:50.940642 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1206/2374] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:29:50.956447 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151364-fdcd-4ba3-913e-252b3fce6068 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:50.956768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151364-fdcd-4ba3-913e-252b3fce6068 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:50.957037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151364-fdcd-4ba3-913e-252b3fce6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:50.997045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a151364-fdcd-4ba3-913e-252b3fce6068 None None] MFA Rules not processed for user `381fb95cc82c425aa2df1e97057cdfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:50.998282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a151364-fdcd-4ba3-913e-252b3fce6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:51.017581 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1169/2375] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:53.298205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:53.421257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279983f-fb1c-41a0-a9ec-0afe359d5979 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:53.434339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:53.435017 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:53.435303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:53.435589 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] PATH_INFO: `/v3/users/8822c46ad36940fc81e33284c113989d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:53.438798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8822c46ad36940fc81e33284c113989d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:53.444254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:53.459522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:53.545454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8822c46ad36940fc81e33284c113989d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:53.576845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8822c46ad36940fc81e33284c113989d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:53.591871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8822c46ad36940fc81e33284c113989d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:53.607692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8822c46ad36940fc81e33284c113989d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:53.608655 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8822c46ad36940fc81e33284c113989d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:53.618110 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1207/2376] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:53 2022] DELETE /identity/v3/users/8822c46ad36940fc81e33284c113989d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:53.622535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:53.623018 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:53.623119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:53.651098 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:53.655827 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:53.804359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1170/2377] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:53.842027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:53.843725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:53.923813 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b2e2d-3ec2-40cb-bbd4-175cd3ded54b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:53.928779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:53.929519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:53.929904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:53.930281 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:53.939931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:53.941550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:53.959510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1208/2378] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:54.668619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:54.670120 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:54.683083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab1d0-0f6e-43b1-9841-f91d59c0ecfc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:54.688918 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:54.689700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:54.690057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:54.690541 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] PATH_INFO: `/v3/projects/810426dcef57434981144a95a19bb237` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:54.693480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810426dcef57434981144a95a19bb237)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:54.695867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:54.750196 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810426dcef57434981144a95a19bb237', 'request_id': 'req-6a8dc64c-998d-4730-ba18-7bd00f4af446'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.753038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:54.758540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810426dcef57434981144a95a19bb237', 'request_id': 'req-6a8dc64c-998d-4730-ba18-7bd00f4af446'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.766805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810426dcef57434981144a95a19bb237', 'request_id': 'req-6a8dc64c-998d-4730-ba18-7bd00f4af446'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.781278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] The token cache is being invalidate because project 810426dcef57434981144a95a19bb237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:54.781575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.782240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.783730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1171/2379] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:54 2022] DELETE /identity/v3/projects/810426dcef57434981144a95a19bb237 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:54.788419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:54.798677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64574-7675-4a24-9994-96d2f868c783 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:54.858721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:54.859408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:54.859578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:54.859832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] PATH_INFO: `/v3/users/f4099af4b3e2493683fe609c22a39c56` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:54.861722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4099af4b3e2493683fe609c22a39c56)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:54.863179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:54.906419 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:54.928890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4099af4b3e2493683fe609c22a39c56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.944230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4099af4b3e2493683fe609c22a39c56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.952805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4099af4b3e2493683fe609c22a39c56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.961698 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4099af4b3e2493683fe609c22a39c56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.962309 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9b71f56-ad68-47d7-8be7-c0ef321d1e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4099af4b3e2493683fe609c22a39c56'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:54.972161 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1209/2380] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:29:54 2022] DELETE /identity/v3/users/f4099af4b3e2493683fe609c22a39c56 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:55.293311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:55.297385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:55.321611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc64c-998d-4730-ba18-7bd00f4af446 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:55.433421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:55.434373 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:55.434658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:55.434938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] PATH_INFO: `/v3/projects/40680bd45c644d3696e5b13e76aa53b7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:55.436148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40680bd45c644d3696e5b13e76aa53b7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:55.438617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:55.514040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40680bd45c644d3696e5b13e76aa53b7', 'request_id': 'req-af17e7a1-8689-4f58-b45f-3865851d2973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:55.524868 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40680bd45c644d3696e5b13e76aa53b7', 'request_id': 'req-af17e7a1-8689-4f58-b45f-3865851d2973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:55.534564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40680bd45c644d3696e5b13e76aa53b7', 'request_id': 'req-af17e7a1-8689-4f58-b45f-3865851d2973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:55.561710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] The token cache is being invalidate because project 40680bd45c644d3696e5b13e76aa53b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:29:55.561855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:55.562769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-af17e7a1-8689-4f58-b45f-3865851d2973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:29:55.568807 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1172/2381] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:29:55 2022] DELETE /identity/v3/projects/40680bd45c644d3696e5b13e76aa53b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:55.570492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:55.570786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:55.571142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:55.622197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:55.631694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:55.727966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1210/2382] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:55.736159 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:55.736935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:55.736935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:55.785103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:55.787852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:55.816956 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1173/2383] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:55.824971 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:55.867665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bcfe3-a139-4a87-899a-341e0fbe1354 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:55.878250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:55.884084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:55.884545 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:55.884906 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:55.886082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:29:55.886592 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:55.888585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:55.914001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1211/2384] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:29:55.920147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:55.933612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae2875-3680-4e64-9bed-a11323a54baf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:55.941658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:55.943713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:55.943713 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:55.944106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:55.945137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:55.947938 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:55.992520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1174/2385] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:55 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:55.995594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.010175 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6552-8255-4c20-8cdf-215437faac84 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.091157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.092182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.092734 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.093037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.093786 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.096191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.121678 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1212/2386] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:55 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:29:56.125736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.138081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdb19-9681-46c9-a52d-888efdc50321 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.145590 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.146292 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.146988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.147277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.147934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.149669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.160742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1175/2387] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:56.165413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.175972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a0e4-bde5-4429-9a38-6dbf962b2198 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.181354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.181977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.182250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.182528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.183189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.184933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7d988-47e7-4ae4-8fb2-f929cc02b4d2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.197767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1213/2388] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:56.202047 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.213671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea409-5354-4fc8-87dd-caef2969787c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.218398 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.219050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.219328 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.219599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] PATH_INFO: `/v3/projects/719dc04611c84bbe90641d461f28e9ea/users/105975a5d68e47c68538094df7153bd0/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.236170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] RBAC: Authorizing `identity:create_grant(project_id=719dc04611c84bbe90641d461f28e9ea, user_id=105975a5d68e47c68538094df7153bd0, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.238908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.252689 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1176/2389] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:56 2022] PUT /identity/v3/projects/719dc04611c84bbe90641d461f28e9ea/users/105975a5d68e47c68538094df7153bd0/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:56.264883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.265193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.265605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.292802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:56.297038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] MFA Rules not processed for user `105975a5d68e47c68538094df7153bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:56.299013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:56.372833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1214/2390] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:56.374531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.386038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:56.457446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06236a-e4cc-480d-92fa-47e5ae1e374c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.462588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.463202 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.463486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.463795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.464385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.466340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.494153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1177/2391] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:29:56 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:56.501816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.516939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1f9a8-2f47-4b87-91f4-6ab64fa81df6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.587917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.588442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.588752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.589032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.589672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.591609 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.618984 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1215/2392] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:29:56 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:29:56.623028 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.634016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89231350-ec6c-49c3-b77a-76eb5166961f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.640939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.641810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.641810 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.642562 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.643218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.645411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.656832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1178/2393] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:56.661157 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.673053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe3752-1172-436c-b66f-b9d7954b053b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.678496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.679154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.679436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.679714 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] PATH_INFO: `/v3/projects/de5b6f96e5714bcbb230375214f05aa3/users/d8aa5b34e496468785e21347240bcf6c/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.696353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5b6f96e5714bcbb230375214f05aa3, user_id=d8aa5b34e496468785e21347240bcf6c, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.699140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.719619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1216/2394] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:56 2022] PUT /identity/v3/projects/de5b6f96e5714bcbb230375214f05aa3/users/d8aa5b34e496468785e21347240bcf6c/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:29:56.724014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.734820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e9fc-373b-4c24-a9b1-d6cbe8ded6a9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.816701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.818627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.819058 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.819513 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.820347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.822841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a889b3-59ba-4dff-ad33-7e7b7017eca8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.836097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1179/2395] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:29:56.840180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:56.853702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfd3b5-747a-4873-b761-8a96807d3d1e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:56.859486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:56.860438 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.861773 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.862273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] PATH_INFO: `/v3/projects/de5b6f96e5714bcbb230375214f05aa3/users/d8aa5b34e496468785e21347240bcf6c/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.866275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5b6f96e5714bcbb230375214f05aa3, user_id=d8aa5b34e496468785e21347240bcf6c, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:56.869120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:56.881794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1217/2396] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:29:56 2022] PUT /identity/v3/projects/de5b6f96e5714bcbb230375214f05aa3/users/d8aa5b34e496468785e21347240bcf6c/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:29:56.892491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:56.892491 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:56.892744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:56.923736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] MFA Rules not processed for user `d8aa5b34e496468785e21347240bcf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:29:56.924761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:57.000357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1180/2397] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:29:57.011555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:57.013989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:57.076020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380d64-4ca2-49ab-8c80-064403d78c3a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:57.079639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:57.080252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:57.080573 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:57.080853 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:57.097385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:57.098125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:57.105447 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:57.113509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1218/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:29:57.163191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:29:57.165008 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:29:57.172423 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:57.184086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3e37a-c3a0-4be1-b18c-231cc29a1dee None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:29:57.188353 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:29:57.189045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:29:57.189343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:29:57.189617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:29:57.252521 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:29:57.253984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:29:57.263988 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1181/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:00.300037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:00.302707 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:00.376335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af290-5528-4860-b98b-09394171a83e service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:00.386460 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:00.387104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:00.387558 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:00.387832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] PATH_INFO: `/v3/users/67ed53d3d20d4c628f580a9a207dd548` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:00.389229 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ed53d3d20d4c628f580a9a207dd548)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:00.391146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:00.440060 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ed53d3d20d4c628f580a9a207dd548'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.453088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ed53d3d20d4c628f580a9a207dd548'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.460621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ed53d3d20d4c628f580a9a207dd548'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.469114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ed53d3d20d4c628f580a9a207dd548'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.469874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ed53d3d20d4c628f580a9a207dd548'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.477416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1219/2400] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:00 2022] DELETE /identity/v3/users/67ed53d3d20d4c628f580a9a207dd548 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:00.659437 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:00.675459 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18fc4b-aebe-420d-bdca-6e7fbf7cc014 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:00.735678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:00.736303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:00.736631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:00.736908 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] PATH_INFO: `/v3/projects/3a2d7267b8fe465187e0011311e10e00` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:00.738011 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2d7267b8fe465187e0011311e10e00)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:00.739962 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:00.789051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2d7267b8fe465187e0011311e10e00', 'request_id': 'req-1531a806-46cf-4809-b1c8-06e3dfeea6c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.797332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2d7267b8fe465187e0011311e10e00', 'request_id': 'req-1531a806-46cf-4809-b1c8-06e3dfeea6c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.806358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2d7267b8fe465187e0011311e10e00', 'request_id': 'req-1531a806-46cf-4809-b1c8-06e3dfeea6c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.818568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] The token cache is being invalidate because project 3a2d7267b8fe465187e0011311e10e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:00.818859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.819505 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.821013 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1182/2401] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:00 2022] DELETE /identity/v3/projects/3a2d7267b8fe465187e0011311e10e00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:00.824966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:00.826467 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:00.839981 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70085-9bbe-482b-b63e-90856f4f5e49 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:00.902861 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:00.903603 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:00.903944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:00.904222 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] PATH_INFO: `/v3/users/3434fabaf97b4d83aad1bf79d3162839` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:00.905414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3434fabaf97b4d83aad1bf79d3162839)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:00.907341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:00.929631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:00.960710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:00.961029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3434fabaf97b4d83aad1bf79d3162839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.962183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:00.973071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3434fabaf97b4d83aad1bf79d3162839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.974816 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a806-46cf-4809-b1c8-06e3dfeea6c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:00.980153 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:00.980321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3434fabaf97b4d83aad1bf79d3162839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.980805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:00.981095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:00.981367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] PATH_INFO: `/v3/users/105975a5d68e47c68538094df7153bd0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:00.982531 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105975a5d68e47c68538094df7153bd0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:00.984862 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:00.987218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3434fabaf97b4d83aad1bf79d3162839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.987972 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c6e25c96-8388-497d-b67e-2ec9aa79f4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3434fabaf97b4d83aad1bf79d3162839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:00.994561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1220/2402] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:00 2022] DELETE /identity/v3/users/3434fabaf97b4d83aad1bf79d3162839 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:30:01.015915 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:01.038660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105975a5d68e47c68538094df7153bd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.046123 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105975a5d68e47c68538094df7153bd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.060737 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105975a5d68e47c68538094df7153bd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.061701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105975a5d68e47c68538094df7153bd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.070486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105975a5d68e47c68538094df7153bd0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.079730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1183/2403] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:00 2022] DELETE /identity/v3/users/105975a5d68e47c68538094df7153bd0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:30:01.081428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:01.081717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:01.082002 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:01.102978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:01.104196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:01.176238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1221/2404] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:01.182118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:01.183805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:01.188080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:01.189775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:01.200148 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36b588-d4ca-4164-94eb-89e23bdc3b25 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:01.205375 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:01.206007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:01.206290 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:01.206565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] PATH_INFO: `/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:01.207701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcacb1356ca544efa6dced8d9c4ed07f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:01.210372 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:01.268338 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16a88-1200-4609-91f7-5d09d7a1b063 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:01.279707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcacb1356ca544efa6dced8d9c4ed07f', 'request_id': 'req-b4348064-7499-45dc-9484-da7867c46bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.288612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcacb1356ca544efa6dced8d9c4ed07f', 'request_id': 'req-b4348064-7499-45dc-9484-da7867c46bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.296849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcacb1356ca544efa6dced8d9c4ed07f', 'request_id': 'req-b4348064-7499-45dc-9484-da7867c46bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.308971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] The token cache is being invalidate because project fcacb1356ca544efa6dced8d9c4ed07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:01.309567 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.310294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.312061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1184/2405] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:01 2022] DELETE /identity/v3/projects/fcacb1356ca544efa6dced8d9c4ed07f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:01.336650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:01.337311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:01.337550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:01.338023 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:01.339973 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:01.348226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:01.418574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:01.420037 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:01.430837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1222/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:01.714841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:01.716327 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:01.730035 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348064-7499-45dc-9484-da7867c46bd1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:01.734778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:01.735509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:01.735790 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:01.736065 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] PATH_INFO: `/v3/projects/719dc04611c84bbe90641d461f28e9ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:01.737266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=719dc04611c84bbe90641d461f28e9ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:01.740021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:01.787020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719dc04611c84bbe90641d461f28e9ea', 'request_id': 'req-e65737f4-5802-4592-87eb-71e8d9ff156a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.795156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719dc04611c84bbe90641d461f28e9ea', 'request_id': 'req-e65737f4-5802-4592-87eb-71e8d9ff156a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.800704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719dc04611c84bbe90641d461f28e9ea', 'request_id': 'req-e65737f4-5802-4592-87eb-71e8d9ff156a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.812928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] The token cache is being invalidate because project 719dc04611c84bbe90641d461f28e9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:01.813241 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.813888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.815359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1185/2407] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:01 2022] DELETE /identity/v3/projects/719dc04611c84bbe90641d461f28e9ea => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:01.819322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:01.828747 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc7f0-eaa4-43cb-8738-aa2a914b73b6 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:01.887162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:01.887879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:01.888233 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:01.888627 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] PATH_INFO: `/v3/users/d8aa5b34e496468785e21347240bcf6c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:01.889805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8aa5b34e496468785e21347240bcf6c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:01.891784 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:01.938585 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8aa5b34e496468785e21347240bcf6c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.951280 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8aa5b34e496468785e21347240bcf6c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.958474 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8aa5b34e496468785e21347240bcf6c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.966015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8aa5b34e496468785e21347240bcf6c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.966712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-883eedc7-717a-4bf2-9858-f48954d906a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8aa5b34e496468785e21347240bcf6c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:01.973228 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1223/2408] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:01 2022] DELETE /identity/v3/users/d8aa5b34e496468785e21347240bcf6c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:02.263336 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.265162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:02.281436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737f4-5802-4592-87eb-71e8d9ff156a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.286339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=20,keystone:SELECT=77,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:02.344832 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.345462 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.345767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.346038 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] PATH_INFO: `/v3/projects/de5b6f96e5714bcbb230375214f05aa3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.347137 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5b6f96e5714bcbb230375214f05aa3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.349239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.399394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5b6f96e5714bcbb230375214f05aa3', 'request_id': 'req-a5a207d6-261c-4566-ad55-deec86bc5c95'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:02.407429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5b6f96e5714bcbb230375214f05aa3', 'request_id': 'req-a5a207d6-261c-4566-ad55-deec86bc5c95'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:02.414174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5b6f96e5714bcbb230375214f05aa3', 'request_id': 'req-a5a207d6-261c-4566-ad55-deec86bc5c95'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:02.425500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] The token cache is being invalidate because project de5b6f96e5714bcbb230375214f05aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:02.425793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:02.426449 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a5a207d6-261c-4566-ad55-deec86bc5c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:02.428600 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1186/2409] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:02 2022] DELETE /identity/v3/projects/de5b6f96e5714bcbb230375214f05aa3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:02.433553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.434047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.434165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.455146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:02.456340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:02.474520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:02.519664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1224/2410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:30:02.527929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.528212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.528535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.550304 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:02.552185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:02.560316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1187/2411] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:02.564506 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.574463 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b341-f0c5-4ae8-9392-8c0d626c9fcf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.579094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.579685 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.579967 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.580240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.580982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:30:02.581301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.583512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.594830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1225/2412] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 19:30:02.599817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.608621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a73dd-bb66-47fd-a4cd-5502eca64865 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.613594 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.614194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.614476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.614771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.615404 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.617385 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.643618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1188/2413] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:02.648402 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.658341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f11bf-452b-4657-bd7b-06463a00e900 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.715526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.716132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.716408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.716712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.717328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.719465 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.740378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1226/2414] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:02.744706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.754902 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb653-e119-4a69-8180-d5b260c949c7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.759702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.760323 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.760627 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.760932 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.761578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.763173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.774227 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1189/2415] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:02.778480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.790179 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b66013-79c7-494c-a4b5-749dfa49527a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.794859 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.795448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.795753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.796022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.796696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.798268 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6eac2-ae9a-4210-a3eb-2d996a115a8f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.808844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1227/2416] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:02.813003 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:02.822860 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d334-fec2-4ce0-bf08-fde679bf94b0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:02.827485 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:02.828128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.828408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.828716 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] PATH_INFO: `/v3/projects/6ddf531622424a6b8c6e43f2fc9b8257/users/3406c0adfb3f4de1afd009f84de56681/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.843539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddf531622424a6b8c6e43f2fc9b8257, user_id=3406c0adfb3f4de1afd009f84de56681, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:02.846265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:02.859347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1190/2417] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:02 2022] PUT /identity/v3/projects/6ddf531622424a6b8c6e43f2fc9b8257/users/3406c0adfb3f4de1afd009f84de56681/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:02.870956 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:02.871243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:02.871522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:02.899145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] MFA Rules not processed for user `3406c0adfb3f4de1afd009f84de56681`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:02.900343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:02.965804 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1228/2418] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:02.970408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.009156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:03.033686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c515f-0745-41b1-b1ff-537b4ed03012 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.038672 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.039540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.039935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.040221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.040884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.042795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.069114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1191/2419] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:02 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:30:03.073177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.084647 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421ce2-89bf-4d60-b1ee-614bc43e1e88 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.096994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:03.140838 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.141439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.141716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.141988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.142624 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.144533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.166005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1229/2420] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:03.170087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.180387 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe25e7-9ed8-46c1-aef6-ad9c5a2e8406 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.185066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.185703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.185970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.186244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.186884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.188499 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.199631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1192/2421] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:03.203692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.215119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d63e00-d85d-4160-ba8e-85371fafc62c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.219810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.220566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.220846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.221122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] PATH_INFO: `/v3/projects/d929a28f113e4765bc36e21caca67f93/users/f39723f938ca4a8f948750a0f80856ee/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.236328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d929a28f113e4765bc36e21caca67f93, user_id=f39723f938ca4a8f948750a0f80856ee, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.239150 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.251621 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1230/2422] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:03 2022] PUT /identity/v3/projects/d929a28f113e4765bc36e21caca67f93/users/f39723f938ca4a8f948750a0f80856ee/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:03.256288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.266136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae25b72-8551-4cd5-ac96-7148863e02f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.322039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.322582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.322858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.323127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.323757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.325396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebca44-89cf-47d7-aeaf-59798028aa42 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.335547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1193/2423] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:03.339692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.349830 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610e19-5221-49d5-a705-331ccf0588f5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.354412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.355046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.355321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.355591 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] PATH_INFO: `/v3/projects/d929a28f113e4765bc36e21caca67f93/users/f39723f938ca4a8f948750a0f80856ee/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.357510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d929a28f113e4765bc36e21caca67f93, user_id=f39723f938ca4a8f948750a0f80856ee, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.360119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.370857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1231/2424] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:03 2022] PUT /identity/v3/projects/d929a28f113e4765bc36e21caca67f93/users/f39723f938ca4a8f948750a0f80856ee/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:03.381657 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.381947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.382223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.418219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] MFA Rules not processed for user `f39723f938ca4a8f948750a0f80856ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:03.419464 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:03.490041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1194/2425] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:03.501760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:03.504071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:03.565024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68593bf-4b42-4da0-9cdf-71c24f3eab97 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:03.569218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:03.569824 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:03.570101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:03.570370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:03.629468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:03.631416 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197242f-c8e6-4698-8e43-eb3b83892f39 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:03.640975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1232/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:06.209811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:06.260578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:06.301455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74bdd-cb02-4218-a89a-b682eff90c56 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:06.306173 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:06.306812 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:06.307620 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:06.307901 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] PATH_INFO: `/v3/users/3406c0adfb3f4de1afd009f84de56681` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:06.310340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3406c0adfb3f4de1afd009f84de56681)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:06.311637 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:06.368268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3406c0adfb3f4de1afd009f84de56681'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:06.375951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3406c0adfb3f4de1afd009f84de56681'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:06.393052 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3406c0adfb3f4de1afd009f84de56681'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:06.393926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3406c0adfb3f4de1afd009f84de56681'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:06.402867 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3406c0adfb3f4de1afd009f84de56681'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:06.410427 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1195/2427] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:06 2022] DELETE /identity/v3/users/3406c0adfb3f4de1afd009f84de56681 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:06.415814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:06.416352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:06.416352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:06.435754 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:06.437012 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:06.455748 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:06.508964 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1233/2428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:06.518618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:06.520650 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:06.583967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250ba54-abc3-4792-9c00-ccf9f2696b08 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:06.587618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:06.588225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:06.588599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:06.588880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:06.600548 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:06.602231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:06.612984 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1196/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:06.915991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:06.917917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:06.942891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120992-46a1-4a22-b80c-f0ef28dbfa4f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:06.948515 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:06.949014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:06.949296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:06.949574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] PATH_INFO: `/v3/projects/6ddf531622424a6b8c6e43f2fc9b8257` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:06.950721 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddf531622424a6b8c6e43f2fc9b8257)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:06.952660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.004336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddf531622424a6b8c6e43f2fc9b8257', 'request_id': 'req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.012985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddf531622424a6b8c6e43f2fc9b8257', 'request_id': 'req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.020001 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddf531622424a6b8c6e43f2fc9b8257', 'request_id': 'req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.033021 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] The token cache is being invalidate because project 6ddf531622424a6b8c6e43f2fc9b8257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:07.033443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.034274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.035877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1234/2430] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:06 2022] DELETE /identity/v3/projects/6ddf531622424a6b8c6e43f2fc9b8257 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:30:07.040207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.050296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9851-c281-4064-8a4b-c7285275ffd8 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.103586 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:07.116239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.116914 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.117200 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.117479 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] PATH_INFO: `/v3/users/f39723f938ca4a8f948750a0f80856ee` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.118615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39723f938ca4a8f948750a0f80856ee)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.120578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.171763 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39723f938ca4a8f948750a0f80856ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.179436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39723f938ca4a8f948750a0f80856ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.193224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39723f938ca4a8f948750a0f80856ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.194136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39723f938ca4a8f948750a0f80856ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.202116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-89756314-2771-41c9-8807-78c3589072f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39723f938ca4a8f948750a0f80856ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.209016 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1197/2431] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:07 2022] DELETE /identity/v3/users/f39723f938ca4a8f948750a0f80856ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:07.487530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.489593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:07.508305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cd5e5-71d3-46ab-aa2a-8b1d0d9effe2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.567795 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.568360 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.568675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.568953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] PATH_INFO: `/v3/projects/d929a28f113e4765bc36e21caca67f93` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.570074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d929a28f113e4765bc36e21caca67f93)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.571977 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.620601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd929a28f113e4765bc36e21caca67f93', 'request_id': 'req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.622271 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:07.629513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd929a28f113e4765bc36e21caca67f93', 'request_id': 'req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.637882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd929a28f113e4765bc36e21caca67f93', 'request_id': 'req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.648483 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] The token cache is being invalidate because project d929a28f113e4765bc36e21caca67f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:07.648778 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.649417 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e9f244e7-f7e9-46f7-9ff2-296f646d3bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:07.650897 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1235/2432] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:07 2022] DELETE /identity/v3/projects/d929a28f113e4765bc36e21caca67f93 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:07.655771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.656251 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.656361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.677371 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:07.678568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:07.738020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1198/2433] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:07.746912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.747199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.747476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.767770 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:07.768999 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:07.778845 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1236/2434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:07.783272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.793517 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eba75-5525-4fbc-8466-71da896e70cb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.798130 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.798726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.799001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.799271 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.799909 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:30:07.800208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.801928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.813228 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1199/2435] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:30:07.818352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.827639 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4a318-d89f-49b5-9eac-3b823154a37f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.832225 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.833660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.833942 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.834212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.834837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.836757 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.866422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1237/2436] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:07 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:07.868046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.878245 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25c97-6066-49a3-af88-18ea5b223ad2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.934518 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.935114 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.935391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.935661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.936287 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.938254 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.946734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:07.961831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1200/2437] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:07 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:07.966056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:07.976151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391218-c7c5-4ea2-919c-8d7f83be51cc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:07.980787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:07.981415 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:07.981687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:07.981958 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:07.982597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:07.984442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:07.996860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1238/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:08.001589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.013092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f2dd-fb24-4573-b5c1-b68206286008 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.017658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.018248 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.018525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.018795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.019430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.021225 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c278b-ae11-4227-b89f-53ade4aa4e0e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.031823 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1201/2439] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:08.036755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.046852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb887-64a2-4998-9ebb-69b75769f0b1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.052094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.052793 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.053074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.053349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] PATH_INFO: `/v3/projects/373319badad54a5b92d2ccd50cb7ad0a/users/5d8e87bbd65148298e5c0f6da97318bf/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.068049 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=373319badad54a5b92d2ccd50cb7ad0a, user_id=5d8e87bbd65148298e5c0f6da97318bf, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.070808 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.084029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1239/2440] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:08 2022] PUT /identity/v3/projects/373319badad54a5b92d2ccd50cb7ad0a/users/5d8e87bbd65148298e5c0f6da97318bf/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:30:08.094744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.095680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.095961 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.123968 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] MFA Rules not processed for user `5d8e87bbd65148298e5c0f6da97318bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:08.125219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:08.189221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1202/2441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:08.194368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.256339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143969c-16f8-4c07-a0de-c69cb44e8e0e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.261004 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.261605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.261889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.262164 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.262802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.264717 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.291227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1240/2442] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:08.295403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.306835 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd56c-8088-434d-a19f-70b9f48efbf2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.362636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.363162 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.363448 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.363710 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.364374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.366320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.390702 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1203/2443] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:08.391837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.402489 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a434e8-d392-4d08-bbf0-b8fe60f3d7e9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.407008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.407593 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.407870 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.408144 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.408820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.410397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.421301 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1241/2444] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:30:08.425249 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.435170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989526f-e71a-4392-8915-6cb96833b074 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.439679 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.440255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.440572 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.440852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.441509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.443693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bdd82-5916-4e2a-a175-29860b8b4532 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.453370 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1204/2445] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:08.457226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.467802 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9efea5-877b-47e8-b933-f0d3023831ef admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.472259 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.472928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.473243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.473519 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] PATH_INFO: `/v3/projects/b3d72b3e46b245f188a9ad98ec7c5bdc/users/aaed5ce6b75945f2befa99d028e550d5/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.488005 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d72b3e46b245f188a9ad98ec7c5bdc, user_id=aaed5ce6b75945f2befa99d028e550d5, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.491027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.506486 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1242/2446] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:08 2022] PUT /identity/v3/projects/b3d72b3e46b245f188a9ad98ec7c5bdc/users/aaed5ce6b75945f2befa99d028e550d5/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:08.516837 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.517131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.517580 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.546117 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] MFA Rules not processed for user `aaed5ce6b75945f2befa99d028e550d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:08.547316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:08.580475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:08.612007 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1205/2447] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:30:08.617207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.645336 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:08.683192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea662ae0-9580-4897-8da4-2d4eb433c76c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.688036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.688683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.688970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.689250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.689895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.691806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.718607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1243/2448] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:30:08.722746 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.733885 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e639e2-6868-4c9e-b4d4-a2dfb399c85c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.793376 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.793991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.794273 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.794575 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.795224 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.797186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.820041 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1206/2449] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:08 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:08.824101 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.834670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54995f5-ffa3-40cb-b8e9-9531903df1bd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.839530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.840128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.840412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.840725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.841375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.842975 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.854120 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1244/2450] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:08.858419 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.869577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc93ad-0160-4a83-b654-c7c465a68d72 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.874158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.874800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.875084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.875360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] PATH_INFO: `/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7/users/e707f0086fd648bc8b1ff287e3652f6d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.891638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e6284088f24b34bd8a64296dbd3dd7, user_id=e707f0086fd648bc8b1ff287e3652f6d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.894381 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.906850 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1207/2451] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:08 2022] PUT /identity/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7/users/e707f0086fd648bc8b1ff287e3652f6d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:08.910800 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:08.921331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb722-9219-4f95-93be-903696b55e9a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:08.982033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:08.982636 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:08.982920 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:08.983197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:08.983833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:08.985454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72eb0-ca68-440a-9230-c97360285c4c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:08.996020 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1245/2452] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:09.000144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:09.010356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616faa5-3ea8-4da6-b40c-d27da571b9f6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:09.014858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:09.015504 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:09.015887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:09.016167 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] PATH_INFO: `/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7/users/e707f0086fd648bc8b1ff287e3652f6d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:09.018046 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e6284088f24b34bd8a64296dbd3dd7, user_id=e707f0086fd648bc8b1ff287e3652f6d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:09.020717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:09.030540 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1208/2453] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:08 2022] PUT /identity/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7/users/e707f0086fd648bc8b1ff287e3652f6d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:09.096216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449645ff-51f2-45df-983b-852430e29769 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:09.096560 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449645ff-51f2-45df-983b-852430e29769 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:09.096842 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449645ff-51f2-45df-983b-852430e29769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:09.125354 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-449645ff-51f2-45df-983b-852430e29769 None None] MFA Rules not processed for user `e707f0086fd648bc8b1ff287e3652f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:09.126485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-449645ff-51f2-45df-983b-852430e29769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:09.193762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1246/2454] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:30:09.210111 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:09.211872 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:09.272508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a14b8-f9a1-4771-9643-cfb32de8f344 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:09.276054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:09.276748 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:09.277027 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:09.277296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:09.318891 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:09.335147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:09.336625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:09.345411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1209/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:10.855195 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449645ff-51f2-45df-983b-852430e29769 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:10.856704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-449645ff-51f2-45df-983b-852430e29769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:10.870994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449645ff-51f2-45df-983b-852430e29769 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:10.874670 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:10.875283 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:10.875563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:10.875837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:10.892705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:10.934323 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:10.935788 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:10.947484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1247/2456] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:11.477280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:11.486231 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b2d4-1039-4eea-a4ec-709beba62724 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:11.490223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:11.490817 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:11.491097 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:11.491367 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:11.500186 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:11.501698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb048-72f3-4ee8-a5a2-7f6b513693ac service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:11.512791 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1210/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:15.396500 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:15.459677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85445b-08bd-41b0-936f-4ff7d31fe1e3 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:15.464265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:15.464931 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:15.465213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:15.465493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] PATH_INFO: `/v3/users/5d8e87bbd65148298e5c0f6da97318bf` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:15.466605 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8e87bbd65148298e5c0f6da97318bf)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:15.468553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:15.516374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8e87bbd65148298e5c0f6da97318bf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:15.529173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8e87bbd65148298e5c0f6da97318bf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:15.537180 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8e87bbd65148298e5c0f6da97318bf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:15.544815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8e87bbd65148298e5c0f6da97318bf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:15.545440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8e87bbd65148298e5c0f6da97318bf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:15.551815 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1248/2458] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:15 2022] DELETE /identity/v3/users/5d8e87bbd65148298e5c0f6da97318bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:15.556547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:15.557001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:15.557156 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:15.576841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:15.578042 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:15.635969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1211/2459] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:15.646252 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:15.647697 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:15.689570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:15.707041 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15940-4889-49b3-9f87-376675a11c74 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:15.711305 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:15.711926 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:15.712202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:15.712481 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:15.721403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:15.722809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:15.732234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1249/2460] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:15.993859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:15.995340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:16.015456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800139-4cfc-47c0-a6f3-a4481edfb48e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:16.020391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:16.021842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:16.022233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:16.022622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] PATH_INFO: `/v3/projects/373319badad54a5b92d2ccd50cb7ad0a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:16.024045 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=373319badad54a5b92d2ccd50cb7ad0a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:16.025981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:16.073661 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373319badad54a5b92d2ccd50cb7ad0a', 'request_id': 'req-070868b8-3058-49b2-9791-510b42485e7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.081055 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373319badad54a5b92d2ccd50cb7ad0a', 'request_id': 'req-070868b8-3058-49b2-9791-510b42485e7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.087004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373319badad54a5b92d2ccd50cb7ad0a', 'request_id': 'req-070868b8-3058-49b2-9791-510b42485e7d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.098051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] The token cache is being invalidate because project 373319badad54a5b92d2ccd50cb7ad0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:16.098341 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.099207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.100726 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1212/2461] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:15 2022] DELETE /identity/v3/projects/373319badad54a5b92d2ccd50cb7ad0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:30:16.104810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:16.115245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252d72-be0f-49a8-944c-1e8948639d1c service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:16.169944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:16.170484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:16.170761 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:16.171048 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] PATH_INFO: `/v3/users/aaed5ce6b75945f2befa99d028e550d5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:16.172137 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaed5ce6b75945f2befa99d028e550d5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:16.174074 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:16.219450 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaed5ce6b75945f2befa99d028e550d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.231803 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaed5ce6b75945f2befa99d028e550d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.238549 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaed5ce6b75945f2befa99d028e550d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.245867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaed5ce6b75945f2befa99d028e550d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.246475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaed5ce6b75945f2befa99d028e550d5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.252153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1250/2462] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:16 2022] DELETE /identity/v3/users/aaed5ce6b75945f2befa99d028e550d5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:16.528764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:16.530246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:16.543697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070868b8-3058-49b2-9791-510b42485e7d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:16.592152 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:16.602724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:16.603358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:16.603644 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:16.603919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] PATH_INFO: `/v3/projects/b3d72b3e46b245f188a9ad98ec7c5bdc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:16.605085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d72b3e46b245f188a9ad98ec7c5bdc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:16.606985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:16.653619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d72b3e46b245f188a9ad98ec7c5bdc', 'request_id': 'req-d1b5a606-76f0-44fd-b580-abd42bb4da99'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.660692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d72b3e46b245f188a9ad98ec7c5bdc', 'request_id': 'req-d1b5a606-76f0-44fd-b580-abd42bb4da99'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.667345 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d72b3e46b245f188a9ad98ec7c5bdc', 'request_id': 'req-d1b5a606-76f0-44fd-b580-abd42bb4da99'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.679129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] The token cache is being invalidate because project b3d72b3e46b245f188a9ad98ec7c5bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:16.679416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.680092 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.681653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1213/2463] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:16 2022] DELETE /identity/v3/projects/b3d72b3e46b245f188a9ad98ec7c5bdc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:16.685626 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:16.687036 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:16.700039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ab9c-cc8a-40f4-9b91-106fa1180963 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:16.756330 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:16.757241 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:16.757523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:16.757798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] PATH_INFO: `/v3/users/e707f0086fd648bc8b1ff287e3652f6d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:16.758915 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e707f0086fd648bc8b1ff287e3652f6d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:16.760858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:16.762282 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:16.811126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e707f0086fd648bc8b1ff287e3652f6d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.823526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e707f0086fd648bc8b1ff287e3652f6d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.832801 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e707f0086fd648bc8b1ff287e3652f6d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.840935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e707f0086fd648bc8b1ff287e3652f6d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.841550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6f279511-e1b7-47dc-aaf9-e0a88933f721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e707f0086fd648bc8b1ff287e3652f6d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:16.847574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1251/2464] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:16 2022] DELETE /identity/v3/users/e707f0086fd648bc8b1ff287e3652f6d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:17.117989 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.119526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:17.132532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5a606-76f0-44fd-b580-abd42bb4da99 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.190460 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.191095 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.191378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.191855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] PATH_INFO: `/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.193451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e6284088f24b34bd8a64296dbd3dd7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.195365 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.243322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e6284088f24b34bd8a64296dbd3dd7', 'request_id': 'req-1e769e4a-123f-40f6-9e31-1fd51460216a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:17.250743 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e6284088f24b34bd8a64296dbd3dd7', 'request_id': 'req-1e769e4a-123f-40f6-9e31-1fd51460216a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:17.257811 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e6284088f24b34bd8a64296dbd3dd7', 'request_id': 'req-1e769e4a-123f-40f6-9e31-1fd51460216a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:17.269587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] The token cache is being invalidate because project e6e6284088f24b34bd8a64296dbd3dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:17.269875 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:17.271232 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e769e4a-123f-40f6-9e31-1fd51460216a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:17.272767 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1214/2465] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:17 2022] DELETE /identity/v3/projects/e6e6284088f24b34bd8a64296dbd3dd7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:17.277580 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.277865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.278140 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.297758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:17.298857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:17.358672 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1252/2466] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:17.366695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.366985 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.367258 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.387566 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:17.388792 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:17.397296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1215/2467] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:17.401586 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.411352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb86af-ac2a-43b6-8cae-3edfbf9cff59 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.416265 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.416900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.417178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.417454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.418104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:30:17.418403 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.419968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.431478 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1253/2468] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:30:17.435836 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.445880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d99f5-2f6a-42ce-be3d-c8e8a1b45e2e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.450604 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.451194 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.451474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.451745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.452366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.454295 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.459350 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:17.483205 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1216/2469] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:17 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:17.487342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.497357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafd344-0926-48d6-8110-63e7c953918c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.555083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.555628 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.555934 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.556213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.556895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.558809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.570547 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:17.584651 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1254/2470] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:17 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:17.585904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.596078 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155fbb-dd60-42e6-8a5d-0eb1273680e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.600744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.601332 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.601609 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.601893 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.602529 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.604115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.613864 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1217/2471] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:17.618356 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.628142 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601d95-ab9c-4e39-ae3c-51a3d00051a1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.634937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.635722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.636172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.636582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.637288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.638862 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb0f3a-3cc2-4154-a40e-0def4edab0f7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.650121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1255/2472] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:17.654164 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.664647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f6616-eaa5-41b3-9302-bb802c9f3d08 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.669253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.669892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.670170 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.670440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] PATH_INFO: `/v3/projects/fc2a04af5b3b48069367d1a291480bd5/users/92f982548050454c96bc7ed0fa70766e/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.686853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2a04af5b3b48069367d1a291480bd5, user_id=92f982548050454c96bc7ed0fa70766e, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.689565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.703197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1218/2473] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:17 2022] PUT /identity/v3/projects/fc2a04af5b3b48069367d1a291480bd5/users/92f982548050454c96bc7ed0fa70766e/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:17.714472 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.715059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.715059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.742694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] MFA Rules not processed for user `92f982548050454c96bc7ed0fa70766e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:17.743890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:17.809189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1256/2474] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:17.820857 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:17.822551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:17.879259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4a179-2cac-4b1c-92ea-3e21b7d12b2a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:17.883525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:17.884119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:17.884396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:17.884695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:17.892749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:17.894204 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accab31-4115-4812-8a1a-81054d9bcdcc service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:17.903012 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1219/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:27.816482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=39 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:27.899039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:42.600028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:42.660653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a506-37b6-49d8-9b5c-c5c8be7e324a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:42.665355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:42.666454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:42.666731 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:42.667167 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] PATH_INFO: `/v3/users/92f982548050454c96bc7ed0fa70766e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:42.668272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f982548050454c96bc7ed0fa70766e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:42.670202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:42.715468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f982548050454c96bc7ed0fa70766e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:42.727423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f982548050454c96bc7ed0fa70766e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:42.734715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f982548050454c96bc7ed0fa70766e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:42.741878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f982548050454c96bc7ed0fa70766e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:42.742484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f982548050454c96bc7ed0fa70766e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:42.749136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1257/2476] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:30:42 2022] DELETE /identity/v3/users/92f982548050454c96bc7ed0fa70766e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:42.753631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:42.754106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:42.754305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:42.773435 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:42.774766 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:42.834706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1220/2477] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:42.844527 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:42.845917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:42.902254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006ed6-c6c8-468a-b913-c82fe554e47c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:42.905890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:42.906498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:42.906765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:42.907040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:42.916879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:42.918496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba4ada-7768-4917-a82e-56f65101b965 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:42.927675 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1258/2478] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:43.193700 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.195253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:43.207764 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d467d-ab87-4891-b7cd-a4b0f40a7836 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.212688 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.214207 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.214621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.214798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] PATH_INFO: `/v3/projects/fc2a04af5b3b48069367d1a291480bd5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.215890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2a04af5b3b48069367d1a291480bd5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.218014 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.271986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2a04af5b3b48069367d1a291480bd5', 'request_id': 'req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:43.279955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2a04af5b3b48069367d1a291480bd5', 'request_id': 'req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:43.285655 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2a04af5b3b48069367d1a291480bd5', 'request_id': 'req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:43.297525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] The token cache is being invalidate because project fc2a04af5b3b48069367d1a291480bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:30:43.297814 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:43.298444 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b61c3e5e-9f5f-4855-91e1-561109e9f1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:30:43.299926 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1221/2479] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:30:43 2022] DELETE /identity/v3/projects/fc2a04af5b3b48069367d1a291480bd5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:43.304978 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba473-949d-4123-9e8b-645971066465 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.305263 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba473-949d-4123-9e8b-645971066465 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.305538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba473-949d-4123-9e8b-645971066465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.327687 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-508ba473-949d-4123-9e8b-645971066465 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:43.328912 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-508ba473-949d-4123-9e8b-645971066465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:43.346342 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:43.390123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1259/2480] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:43.397949 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.398233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.398536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.419082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:43.420275 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:43.428080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1222/2481] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:43.432286 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba473-949d-4123-9e8b-645971066465 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.441716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba473-949d-4123-9e8b-645971066465 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.446203 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.446794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.447076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.448007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.448819 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:30:43.449125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.450702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.461968 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1260/2482] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:30:43.466805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.475947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257da9b-06fb-470b-88a5-5d019e9277ef None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.480717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.481308 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.481585 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.481888 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.482549 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.484434 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.513128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1223/2483] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:30:43 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:30:43.517285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.528530 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f66bed-4c46-4b87-b581-8cd9df4c2d8d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.585962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.586565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.586847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.587123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.588405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.590760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.611713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1261/2484] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:30:43 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:30:43.615745 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.626595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece7c2-8e7f-4ccb-9d8f-390019d52081 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.631476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.632061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.632337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.632652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.633291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.635592 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.645439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1224/2485] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:30:43.649243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.660433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3b3fb-0973-4b0f-9b26-cb842381950a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.665296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.666059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.666476 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.666750 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.667387 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.668994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80eacf-9369-4796-94cc-2fc9a78735c0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.679665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1262/2486] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:30:43.684288 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.694006 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed9fc9-9e4f-48c3-980b-4f6a40c95c56 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.699199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.699829 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.700107 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.700377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] PATH_INFO: `/v3/projects/a4b817e7e64245198149fc225004140d/users/2607607b8d00409ab2a02713d2cfe900/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.715320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b817e7e64245198149fc225004140d, user_id=2607607b8d00409ab2a02713d2cfe900, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.718051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.733267 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1225/2487] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:30:43 2022] PUT /identity/v3/projects/a4b817e7e64245198149fc225004140d/users/2607607b8d00409ab2a02713d2cfe900/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:30:43.743574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.743860 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.744702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.773868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] MFA Rules not processed for user `2607607b8d00409ab2a02713d2cfe900`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:30:43.775160 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:43.839738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1263/2488] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:30:43.850706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:30:43.852658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:30:43.874707 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:43.912140 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecff3f-b0e6-4c7e-9d81-304f342e50d1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:30:43.916158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:30:43.916809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:30:43.917115 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:30:43.917389 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:30:43.925536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:30:43.926950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e5a54-f6fc-48e4-b946-c8a7fc1b62a8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:30:43.936502 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1226/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:30:53.836393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:53.931667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=17 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:16.938230 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:16.999769 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f85e7-72f0-4ea1-8288-1800db82a160 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:17.004236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:17.004881 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:17.005162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:17.005437 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] PATH_INFO: `/v3/users/2607607b8d00409ab2a02713d2cfe900` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:17.006574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2607607b8d00409ab2a02713d2cfe900)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:17.008526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:17.053374 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2607607b8d00409ab2a02713d2cfe900'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.065896 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2607607b8d00409ab2a02713d2cfe900'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.072683 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2607607b8d00409ab2a02713d2cfe900'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.079833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2607607b8d00409ab2a02713d2cfe900'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.080443 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2607607b8d00409ab2a02713d2cfe900'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.086205 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1264/2490] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:31:16 2022] DELETE /identity/v3/users/2607607b8d00409ab2a02713d2cfe900 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:31:17.090699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:17.091210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:17.091316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:17.111057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:31:17.112259 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:17.170582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1227/2491] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:31:17.180274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:17.181807 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:17.236985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfe530-2ce2-403f-8fca-b04a5fb07890 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:17.240582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:17.241170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:17.241448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:17.241715 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:17.251126 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:17.252555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:17.261653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1265/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:31:17.530622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:17.532216 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:17.548543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587edd4-fb7b-4cd5-bdbb-c7a31891b908 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:17.554618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:17.555285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:17.555475 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:17.555729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] PATH_INFO: `/v3/projects/a4b817e7e64245198149fc225004140d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:17.556877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b817e7e64245198149fc225004140d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:17.558793 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:17.605697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b817e7e64245198149fc225004140d', 'request_id': 'req-5a2c5d8a-b808-46d0-908d-09f40738cbbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.613520 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b817e7e64245198149fc225004140d', 'request_id': 'req-5a2c5d8a-b808-46d0-908d-09f40738cbbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.619100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b817e7e64245198149fc225004140d', 'request_id': 'req-5a2c5d8a-b808-46d0-908d-09f40738cbbd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.630192 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] The token cache is being invalidate because project a4b817e7e64245198149fc225004140d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:31:17.630480 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.631103 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:31:17.632608 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1228/2493] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:31:17 2022] DELETE /identity/v3/projects/a4b817e7e64245198149fc225004140d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:31:24.023086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:24.024482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:24.050479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:24.081553 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d51d-ae06-4236-8c88-f2a67e548574 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:24.128943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:24.129541 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:24.129817 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:24.130086 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:24.131798 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:24.199835 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:24.201314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:24.212186 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1266/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:31:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:31:27.627197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:28.687433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:28.689091 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:28.747229 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5d8a-b808-46d0-908d-09f40738cbbd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:28.750899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:28.751508 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:28.751789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:28.752062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:28.753830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:28.767109 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:28.768570 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:28.782036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1229/2495] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:31:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:31:34.207332 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=64 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:38.776102 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=26 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:58.002811 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:31:58.004257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:58.016646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad2f2-8677-4e77-865d-f831dfd2f287 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:31:58.020121 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:31:58.020745 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:31:58.021025 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:31:58.021295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:31:58.022962 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:31:58.032787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:31:58.034191 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:31:58.042221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1267/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:32:08.038665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:33:56.320416 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:33:56.321904 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:33:56.340356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb891-8459-459e-92b9-cdded7586f97 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:33:56.346405 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:33:56.347020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:33:56.347301 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:33:56.347617 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:33:56.349344 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:33:56.363255 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:33:56.364995 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe50ca4-63b2-41e1-9f5d-ef4820e66e41 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:33:56.378896 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1230/2497] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:33:56.473938 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:33:56.475427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:33:56.570856 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3933e-9ea2-4350-94de-5544c1c09a9b service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:33:56.578117 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:33:56.579153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:33:56.579855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:33:56.580339 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:33:56.582876 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:33:56.596397 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:33:56.598035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:33:56.611442 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1268/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:33:59.892039 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:33:59.892589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:33:59.892756 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:33:59.914753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] MFA Rules not processed for user `381fb95cc82c425aa2df1e97057cdfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:33:59.916379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:33:59.976356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1231/2499] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:33:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:34:00.281250 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:34:00.291035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f3dc-cead-4b7a-87f5-c17c38c7de7c service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:34:00.295000 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:34:00.295594 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:34:00.295904 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:34:00.296208 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:34:00.297960 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:00.308176 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:34:00.309665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:34:00.317706 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1269/2500] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:34:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:34:00.646230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:34:00.647852 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:00.663612 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3626a0-2aab-4faa-b99b-a2e023d71f1d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:34:00.668802 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:34:00.669477 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:34:00.669846 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:34:00.670219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:34:00.672037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:00.684390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:34:00.689354 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:34:00.700383 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1232/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:34:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:34:09.470857 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:34:09.472285 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:09.489173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4d51c-3edf-4e49-a48f-2d19b63c8630 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:34:09.494736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:34:09.495334 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:34:09.496404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:34:09.496727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:34:09.498446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:09.510412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:34:09.511985 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:34:09.525865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1270/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:34:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:34:10.695394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=37 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:34:13.672847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:34:13.685877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b19ede-a767-4d20-b034-ba79b9f51768 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:34:13.691421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:34:13.692024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:34:13.692303 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:34:13.692605 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:34:13.694307 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:34:13.707409 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:34:13.709025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:34:13.719877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1233/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 19:34:19.519182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=44 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:34:23.715235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:29.181755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:29.193563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40096-b38b-45b4-9584-d10b1cbb8888 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:29.199015 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:29.199608 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:29.199890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:29.200765 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:29.202723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:29.213169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:29.214738 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:29.223891 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1271/2504] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:39.219779 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:48.126839 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:48.136306 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe988df3-c5bd-4d2a-99e5-0d25c5990a92 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:48.140967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:48.141568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:48.141851 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:48.142129 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:48.143887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:48.208778 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:48.210213 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:48.220595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1234/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:51.270359 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:51.282340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bdf24-3fe7-4e01-a9c1-283fbf1de6f9 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:51.287879 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:51.288537 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.288820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.289082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.290988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:51.305303 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:51.306905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:51.319844 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1272/2506] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:51.340724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:51.342399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:51.359268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ddeb-d46c-426d-be93-58bf3bcc9501 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:51.364222 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:51.364900 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.365182 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.365573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] PATH_INFO: `/v3/users/381fb95cc82c425aa2df1e97057cdfd9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.366714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381fb95cc82c425aa2df1e97057cdfd9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:51.368659 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:51.417337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381fb95cc82c425aa2df1e97057cdfd9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.424761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381fb95cc82c425aa2df1e97057cdfd9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.437128 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381fb95cc82c425aa2df1e97057cdfd9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.437849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381fb95cc82c425aa2df1e97057cdfd9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.445138 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39bba479-2b1e-4bb6-860d-eee7f0ce1c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381fb95cc82c425aa2df1e97057cdfd9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.451161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1235/2507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:35:51 2022] DELETE /identity/v3/users/381fb95cc82c425aa2df1e97057cdfd9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:51.628421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:51.639288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99bc31-5e38-4419-a8f8-048e76529df0 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:51.697741 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:51.698296 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.698576 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.698849 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] PATH_INFO: `/v3/projects/bd38188a9de34acf92b0738ab24fb2d7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.699949 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd38188a9de34acf92b0738ab24fb2d7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:51.701948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:51.750289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd38188a9de34acf92b0738ab24fb2d7', 'request_id': 'req-5f7f7565-8ecc-453f-8f1e-a15268b338ed'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.757692 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd38188a9de34acf92b0738ab24fb2d7', 'request_id': 'req-5f7f7565-8ecc-453f-8f1e-a15268b338ed'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.764307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd38188a9de34acf92b0738ab24fb2d7', 'request_id': 'req-5f7f7565-8ecc-453f-8f1e-a15268b338ed'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.776198 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] The token cache is being invalidate because project bd38188a9de34acf92b0738ab24fb2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:35:51.776521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.777239 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-5f7f7565-8ecc-453f-8f1e-a15268b338ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:51.778979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1273/2508] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:35:51 2022] DELETE /identity/v3/projects/bd38188a9de34acf92b0738ab24fb2d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:51.784356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.784695 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.784969 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.809635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:51.810945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:51.873429 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1236/2509] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:51.881758 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6715f-7041-486e-823c-45f337882116 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.882046 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6715f-7041-486e-823c-45f337882116 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.882322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6715f-7041-486e-823c-45f337882116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.902370 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3cf6715f-7041-486e-823c-45f337882116 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:51.903559 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3cf6715f-7041-486e-823c-45f337882116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:51.912391 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1274/2510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:51.916497 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:51.926066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baf35-8512-48cc-b119-44b87dda2b8d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:51.930615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:51.931208 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.931488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.931761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.932407 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:35:51.932744 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:51.934326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:51.935771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:51.948347 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1237/2511] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:35:51.953172 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6715f-7041-486e-823c-45f337882116 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:51.962307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6715f-7041-486e-823c-45f337882116 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:51.966887 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:51.967571 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:51.968349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:51.968782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:51.969421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:51.971313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.008440 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1275/2512] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:51 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:52.012724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.023357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1feda-ed0d-467e-aff5-7ae8552f777b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.078532 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.079119 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.079408 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.079683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.080305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.082237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.103847 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1238/2513] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:52 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:52.107928 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.118587 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e02f3-f7cc-4620-bb54-d650d1521c27 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.123187 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.123799 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.124088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.124372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.125108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.126682 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.136372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1276/2514] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 19:35:52.140770 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.150596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b7e1-ab2a-4bd0-ab4c-2564731da456 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.155729 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.156320 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.156669 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.156993 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.157681 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.159277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54055814-0b98-4327-b3a8-aa920b365056 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.170082 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1239/2515] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:52.174331 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.184082 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ae815-1f2a-4be8-8d72-d2fb5f3f560c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.189273 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.189913 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.190202 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.190480 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] PATH_INFO: `/v3/projects/f49802cdd3da40628cdcf3960597ce65/users/e119b0323f904ffea761a23595dcb0a3/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.205929 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49802cdd3da40628cdcf3960597ce65, user_id=e119b0323f904ffea761a23595dcb0a3, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.208590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.222395 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1277/2516] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:52 2022] PUT /identity/v3/projects/f49802cdd3da40628cdcf3960597ce65/users/e119b0323f904ffea761a23595dcb0a3/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:52.233886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.234199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.234474 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.261820 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] MFA Rules not processed for user `e119b0323f904ffea761a23595dcb0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:52.263023 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:52.327721 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1240/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:52.332317 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.337846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:52.394620 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73a24-49de-4a05-ac0e-f7c65bdd52c4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.399261 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.399858 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.400138 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.400410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.401064 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.402953 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.428676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1278/2518] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:52 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:52.432699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.445750 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de2bf-0cde-474c-ad2c-eeb492b0cc54 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.501769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.502384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.502666 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.502941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.503577 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.505587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.515919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:52.528399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1241/2519] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:52 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:52.532732 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.543045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020fa7c-e390-4579-bb9c-995a48fb7e45 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.548076 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.548699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.548979 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.549254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.549894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.551469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.562742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1279/2520] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:52.566971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.577458 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43045551-28c1-42b7-9045-ebc39bb533c5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.582030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.582671 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.582947 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.583218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] PATH_INFO: `/v3/projects/d3dc315c2273413aa1b92bea4f89e66c/users/09302ce2b3b5422f9cd13587cce94f03/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.598789 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dc315c2273413aa1b92bea4f89e66c, user_id=09302ce2b3b5422f9cd13587cce94f03, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.601446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.613831 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1242/2521] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:52 2022] PUT /identity/v3/projects/d3dc315c2273413aa1b92bea4f89e66c/users/09302ce2b3b5422f9cd13587cce94f03/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:52.617878 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.628337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732301d-0310-44a6-b220-6f2f04409d85 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.683965 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.684590 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.684873 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.685146 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.685782 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.688177 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2817e2-1299-483c-83b2-5567d3feaadc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.697749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1280/2522] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:52.701869 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.712399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57245a-038f-4b9f-9b9c-8cb5bd2adb89 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.716907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.717701 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.717987 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.718261 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] PATH_INFO: `/v3/projects/d3dc315c2273413aa1b92bea4f89e66c/users/09302ce2b3b5422f9cd13587cce94f03/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.720134 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dc315c2273413aa1b92bea4f89e66c, user_id=09302ce2b3b5422f9cd13587cce94f03, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.722762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.732610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1243/2523] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:52 2022] PUT /identity/v3/projects/d3dc315c2273413aa1b92bea4f89e66c/users/09302ce2b3b5422f9cd13587cce94f03/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:52.743159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.743448 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.743727 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.771418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] MFA Rules not processed for user `09302ce2b3b5422f9cd13587cce94f03`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:52.772623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:52.838053 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:52.841713 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1281/2524] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:52.852489 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:52.854230 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:52.911842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b657e1-c7cf-4091-9741-6f386b751f7f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:52.915705 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:52.916299 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:52.916615 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:52.916890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:52.926936 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:52.928390 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b03641-fd24-4445-b0ad-552b7a1b84df service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:52.938352 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1244/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:54.257941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:54.322411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f4315-542d-4ddb-bf3a-1e9537ff8184 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:54.327302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:54.327943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:54.328212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:54.329454 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] PATH_INFO: `/v3/users/e119b0323f904ffea761a23595dcb0a3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:54.330614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e119b0323f904ffea761a23595dcb0a3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:54.332632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:54.378836 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e119b0323f904ffea761a23595dcb0a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.390521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e119b0323f904ffea761a23595dcb0a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.398262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e119b0323f904ffea761a23595dcb0a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.405709 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e119b0323f904ffea761a23595dcb0a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.406329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e119b0323f904ffea761a23595dcb0a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.413337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1282/2526] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:35:54 2022] DELETE /identity/v3/users/e119b0323f904ffea761a23595dcb0a3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:54.417842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:54.418318 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:54.418418 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:54.436774 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:54.437974 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:54.495858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1245/2527] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:54.506038 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:54.507464 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:54.565716 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dea3f-c9c7-4e57-ac69-cba1d0fc35f3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:54.569378 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:54.569974 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:54.570254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:54.570531 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:54.580574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:54.581933 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:54.591240 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1283/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:54.855411 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:54.856941 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:54.869982 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec059c-b2b3-41ea-ade2-a99aa558706d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:54.874611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:54.875264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:54.876106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:54.876378 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] PATH_INFO: `/v3/projects/f49802cdd3da40628cdcf3960597ce65` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:54.877658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49802cdd3da40628cdcf3960597ce65)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:54.879574 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:54.927343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49802cdd3da40628cdcf3960597ce65', 'request_id': 'req-2bb73219-b810-43d0-9830-5170f5a3976a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.929849 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:54.934747 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49802cdd3da40628cdcf3960597ce65', 'request_id': 'req-2bb73219-b810-43d0-9830-5170f5a3976a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.942589 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49802cdd3da40628cdcf3960597ce65', 'request_id': 'req-2bb73219-b810-43d0-9830-5170f5a3976a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.953618 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] The token cache is being invalidate because project f49802cdd3da40628cdcf3960597ce65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:35:54.954050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.954693 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:54.956172 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1246/2529] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:35:54 2022] DELETE /identity/v3/projects/f49802cdd3da40628cdcf3960597ce65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:54.960124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:54.969890 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81891504-f22b-4cec-8338-947cb5f0b559 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:54.988123 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:55.028744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.029392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.029674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.029941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] PATH_INFO: `/v3/users/09302ce2b3b5422f9cd13587cce94f03` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.031047 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09302ce2b3b5422f9cd13587cce94f03)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.033080 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.080245 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09302ce2b3b5422f9cd13587cce94f03'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.092081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09302ce2b3b5422f9cd13587cce94f03'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.098991 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09302ce2b3b5422f9cd13587cce94f03'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.106213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09302ce2b3b5422f9cd13587cce94f03'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.106841 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-afeb843c-ad32-4fa3-8d5f-983d7b37bf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09302ce2b3b5422f9cd13587cce94f03'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.113291 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1284/2530] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:35:54 2022] DELETE /identity/v3/users/09302ce2b3b5422f9cd13587cce94f03 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:55.382151 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.383635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:55.397183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73219-b810-43d0-9830-5170f5a3976a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.454470 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.455112 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.455369 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.455645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] PATH_INFO: `/v3/projects/d3dc315c2273413aa1b92bea4f89e66c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.456795 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3dc315c2273413aa1b92bea4f89e66c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.458697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.503876 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3dc315c2273413aa1b92bea4f89e66c', 'request_id': 'req-835c39d3-1c7c-4f1b-8882-6df2523f875e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.511842 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3dc315c2273413aa1b92bea4f89e66c', 'request_id': 'req-835c39d3-1c7c-4f1b-8882-6df2523f875e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.518514 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3dc315c2273413aa1b92bea4f89e66c', 'request_id': 'req-835c39d3-1c7c-4f1b-8882-6df2523f875e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.529436 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] The token cache is being invalidate because project d3dc315c2273413aa1b92bea4f89e66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:35:55.529724 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.530349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-835c39d3-1c7c-4f1b-8882-6df2523f875e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:55.531853 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1247/2531] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:35:55 2022] DELETE /identity/v3/projects/d3dc315c2273413aa1b92bea4f89e66c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:55.536695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b77ae-2134-4924-9347-84f3e542320b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.537463 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b77ae-2134-4924-9347-84f3e542320b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.537563 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b77ae-2134-4924-9347-84f3e542320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.558314 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-094b77ae-2134-4924-9347-84f3e542320b None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:55.559525 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-094b77ae-2134-4924-9347-84f3e542320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:55.618351 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1285/2532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:55.626983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.627211 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.627493 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.647025 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:55.648221 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:55.656516 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1248/2533] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:35:55.661300 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b77ae-2134-4924-9347-84f3e542320b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.671295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b77ae-2134-4924-9347-84f3e542320b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.677022 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.677619 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.677899 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.678173 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.678825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:35:55.679132 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.680755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.693329 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1286/2534] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:35:55.699298 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.708894 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9c31-ff9d-491d-a1ae-5b7e1624f7d8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.713486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.714083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.714357 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.714628 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.715257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.717283 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.744391 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1249/2535] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:55.748521 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.758882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416be2-2367-423b-a771-6f460d767087 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.783821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:55.815900 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.816570 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.816847 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.817119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.817742 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.819633 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.838850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1287/2536] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:55 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:55.842976 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.853638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9693b8-cbd9-43ff-b5a5-95a03386094a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.858568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.859160 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.859440 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.860234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.860937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.862587 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.872539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1250/2537] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:55.877277 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.887182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349776-0d26-40b3-b297-2c0b6a344490 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.891850 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.892439 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.892753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.893032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.893671 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.895248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74290cf1-ab7e-49ea-add3-4cdc6a00d5e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.905666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1288/2538] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:55.909730 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:55.919921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b9f06-e764-484d-9b11-c4bd86e2e567 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:55.925337 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:55.925983 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.926268 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.926544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] PATH_INFO: `/v3/projects/c95375508ebf4637a262854e6cf942c5/users/85af6ebf3d3b445fa1ccce24a803224d/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.941598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95375508ebf4637a262854e6cf942c5, user_id=85af6ebf3d3b445fa1ccce24a803224d, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:55.944235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:55.956533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1251/2539] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:55 2022] PUT /identity/v3/projects/c95375508ebf4637a262854e6cf942c5/users/85af6ebf3d3b445fa1ccce24a803224d/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:55.966522 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:55.966805 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:55.967078 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:55.995832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] MFA Rules not processed for user `85af6ebf3d3b445fa1ccce24a803224d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:55.997189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:56.064418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1289/2540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:56.068905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.077799 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:56.132733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c605d0-e071-404e-9418-de7136223b87 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.137333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.137935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.138218 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.138495 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.139127 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.141154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.167653 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1252/2541] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:56 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:56.171708 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.182694 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553de64-0ead-4269-af84-0f640f17adc4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.237462 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.238127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.238408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.238701 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.239355 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.241333 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.264512 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1290/2542] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:56 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:56.265928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.277607 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879dd5-3c06-48d7-b2f7-014f12c4fd93 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.282769 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.283355 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.283631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.283906 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.284647 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.286240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.298266 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1253/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:56.302488 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.312153 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2fb26-6f80-4e61-9178-61ddec98742f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.316833 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.317766 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.318071 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.318347 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] PATH_INFO: `/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0/users/b03dc3897cfe4a4fbc57beb1af1ce30b/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.333322 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c7ea0d2fd3480b904d8e7bf067fca0, user_id=b03dc3897cfe4a4fbc57beb1af1ce30b, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.335961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.348816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1291/2544] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:56 2022] PUT /identity/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0/users/b03dc3897cfe4a4fbc57beb1af1ce30b/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:56.352684 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.363143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41533ef1-7f41-41ed-92c9-45ecf898e754 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.419024 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.419536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.419794 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.420118 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.420787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.422396 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713475d8-b652-4715-b11b-af856011a841 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.432036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1254/2545] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:56.436095 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.442335 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:56.449165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7bea-d454-4f4a-a194-a4bf6d1d9827 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.454520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.455190 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.455469 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.455760 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] PATH_INFO: `/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0/users/b03dc3897cfe4a4fbc57beb1af1ce30b/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.457634 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c7ea0d2fd3480b904d8e7bf067fca0, user_id=b03dc3897cfe4a4fbc57beb1af1ce30b, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.460243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.471404 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1292/2546] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:56 2022] PUT /identity/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0/users/b03dc3897cfe4a4fbc57beb1af1ce30b/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:56.481454 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.481934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.482051 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.509272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] MFA Rules not processed for user `b03dc3897cfe4a4fbc57beb1af1ce30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:56.510472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:56.577966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1255/2547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:56.590054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.591763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:56.650055 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c812-49ff-460e-85ae-e4d3eef62504 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.653614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.654207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.654484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.655008 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.664674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.666081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f0c1-b089-48f0-9644-7ef0e61dcd4b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.675498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1293/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:56.705154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.709325 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:56.768223 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ac39-c041-4187-ac93-e0f783eba990 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:56.772951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:56.773683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.773986 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.774263 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] PATH_INFO: `/v3/users/85af6ebf3d3b445fa1ccce24a803224d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.775456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85af6ebf3d3b445fa1ccce24a803224d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:56.777457 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:56.823536 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85af6ebf3d3b445fa1ccce24a803224d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:56.831100 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85af6ebf3d3b445fa1ccce24a803224d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:56.842945 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85af6ebf3d3b445fa1ccce24a803224d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:56.843621 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85af6ebf3d3b445fa1ccce24a803224d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:56.851158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85af6ebf3d3b445fa1ccce24a803224d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:56.857080 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1256/2549] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:35:56 2022] DELETE /identity/v3/users/85af6ebf3d3b445fa1ccce24a803224d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:56.862056 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:56.862337 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:56.862607 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:56.881577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:56.882755 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:56.940667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1294/2550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:56.950276 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:56.951663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:57.008362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c577-8d2e-44ff-a678-0dfc05989e11 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:57.012049 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:57.012678 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:57.012959 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:57.013235 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:57.023147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:57.024630 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:57.033992 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1257/2551] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:57.306111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:57.307653 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:57.321880 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cfbde-2cd7-429b-922e-a6e03d78e339 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:57.326632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:57.327485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:57.327775 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:57.328081 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] PATH_INFO: `/v3/projects/c95375508ebf4637a262854e6cf942c5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:57.329664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95375508ebf4637a262854e6cf942c5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:57.331566 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:57.380520 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95375508ebf4637a262854e6cf942c5', 'request_id': 'req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.387421 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95375508ebf4637a262854e6cf942c5', 'request_id': 'req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.393871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95375508ebf4637a262854e6cf942c5', 'request_id': 'req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.403947 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] The token cache is being invalidate because project c95375508ebf4637a262854e6cf942c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:35:57.404234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.404884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.406426 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1295/2552] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:35:57 2022] DELETE /identity/v3/projects/c95375508ebf4637a262854e6cf942c5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:57.410565 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:57.420438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec3fa-dc0c-4aac-b936-3284636f8fda service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:57.441154 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:57.478708 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:57.479338 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:57.479616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:57.479889 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] PATH_INFO: `/v3/users/b03dc3897cfe4a4fbc57beb1af1ce30b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:57.481079 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03dc3897cfe4a4fbc57beb1af1ce30b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:57.482930 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:57.527294 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03dc3897cfe4a4fbc57beb1af1ce30b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.534740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03dc3897cfe4a4fbc57beb1af1ce30b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.546599 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03dc3897cfe4a4fbc57beb1af1ce30b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.548161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03dc3897cfe4a4fbc57beb1af1ce30b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.554542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-eafac98b-4b94-43a0-b378-3af36b8addce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03dc3897cfe4a4fbc57beb1af1ce30b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.560379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1258/2553] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:35:57 2022] DELETE /identity/v3/users/b03dc3897cfe4a4fbc57beb1af1ce30b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:57.828948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:57.830393 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:57.846324 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa34d0-2e6b-4e3c-9aca-ea4de1f4f140 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:57.859238 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:57.905199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:57.905826 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:57.906125 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:57.906412 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] PATH_INFO: `/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:57.908170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c7ea0d2fd3480b904d8e7bf067fca0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:57.910109 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:57.955552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c7ea0d2fd3480b904d8e7bf067fca0', 'request_id': 'req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.962665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c7ea0d2fd3480b904d8e7bf067fca0', 'request_id': 'req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.968810 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c7ea0d2fd3480b904d8e7bf067fca0', 'request_id': 'req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.979069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] The token cache is being invalidate because project 43c7ea0d2fd3480b904d8e7bf067fca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:35:57.979358 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.980024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-838f0f43-cd0c-4a3b-b8da-d6a3fa363c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:35:57.981534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1296/2554] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:35:57 2022] DELETE /identity/v3/projects/43c7ea0d2fd3480b904d8e7bf067fca0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:35:57.986870 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:57.987158 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:57.987432 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.007616 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:58.008783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:58.068201 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1259/2555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:58.077067 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.077353 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.077631 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.097051 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:58.098243 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:58.106054 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1297/2556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 19:35:58.110887 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.120596 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590598b-0a21-4a9d-a19b-9a3bed0fdbbf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.125181 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.126543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.126844 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.127116 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.127757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:35:58.128061 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.129691 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.141146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1260/2557] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:35:58.145413 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.154496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32622f-fc7c-4d16-87bc-39721fbadc9c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.159352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.159943 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.160221 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.160524 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.161162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.163302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.191832 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1298/2558] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:58.195813 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.206174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01ca2-2190-498f-84aa-ecdff1879333 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.236539 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:58.267379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.267907 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.268185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.268472 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.269108 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.271001 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.295401 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1261/2559] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:58 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:58.300292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.310348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8a8f-7787-45b5-83fc-5d18690f95ba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.314954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.315538 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.315814 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.316083 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.316753 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.318364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.327988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1299/2560] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:58.331910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.343199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e52c0-38c7-4220-8004-47bd208fc291 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.348272 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.348892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.349169 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.349439 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.350071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.351663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3dc8d-e99e-4912-90ef-76e6090daa07 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.363892 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1262/2561] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:58.368013 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.378518 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a6d2a-d7e2-41d8-ae83-eca2f27c9a27 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.383178 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.383821 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.384106 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.384385 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] PATH_INFO: `/v3/projects/b542a38dd7ca4cb4a7dd5271efc6a423/users/31f25fc0ffc74698b07d69161b64cdff/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.399523 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b542a38dd7ca4cb4a7dd5271efc6a423, user_id=31f25fc0ffc74698b07d69161b64cdff, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.402212 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.416292 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1300/2562] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:58 2022] PUT /identity/v3/projects/b542a38dd7ca4cb4a7dd5271efc6a423/users/31f25fc0ffc74698b07d69161b64cdff/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:35:58.421749 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6175-d361-47bf-9189-e32da1f50922 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.423442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6175-d361-47bf-9189-e32da1f50922 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.423442 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6175-d361-47bf-9189-e32da1f50922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.445062 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-226d6175-d361-47bf-9189-e32da1f50922 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:58.446265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-226d6175-d361-47bf-9189-e32da1f50922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:58.504399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1263/2563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:58.514111 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:58.516039 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:58.562275 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:58.574902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bed0-6a89-4823-90bb-347b5df9f5ef admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:58.578517 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:58.579116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:58.579392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:58.579660 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:58.588441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:58.589889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:58.599863 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1301/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:35:59.214564 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.214954 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.215293 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.244242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] MFA Rules not processed for user `31f25fc0ffc74698b07d69161b64cdff`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:35:59.245573 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:35:59.321492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1264/2565] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:35:59.325768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.336503 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f712f5-9967-4a6c-9a4f-0356d7d1fa8e service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.341007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.341597 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.341874 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.342145 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.342902 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.345122 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.373501 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1302/2566] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:35:59 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:35:59.378476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.390333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c60e0-6cba-4021-8ac6-1f9f78261dde None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.439030 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:35:59.459762 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.460374 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.460686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.461086 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.461742 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.463663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.488636 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1265/2567] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:35:59 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:35:59.493114 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.508072 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0399f-71c8-426d-b028-61918c24e99f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.512877 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.513852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.514174 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.514453 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.515485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.518216 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.532903 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1303/2568] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:59.537610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.548522 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aaf6e-c269-4857-8d7e-b06000268a77 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.554614 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.555219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.555534 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.555877 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] PATH_INFO: `/v3/projects/fd85f0a0eb06452c8e8c19728890dd98/users/10c9cfa503424dce99910e4beaad508d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.574663 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd85f0a0eb06452c8e8c19728890dd98, user_id=10c9cfa503424dce99910e4beaad508d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.577361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.591526 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1266/2569] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:59 2022] PUT /identity/v3/projects/fd85f0a0eb06452c8e8c19728890dd98/users/10c9cfa503424dce99910e4beaad508d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 19:35:59.595772 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.606623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0bdc-a27d-4a27-a2cf-31bc721a7a1d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.671699 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.672944 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.673382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.673939 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.674599 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.676193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82aebd-e19b-413f-878b-87c53c800e96 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.690341 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1304/2570] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:35:59.696714 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:35:59.709036 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e199f-ff54-4196-8d09-22944798fded admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:35:59.713706 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:35:59.714358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:35:59.714635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:35:59.714903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] PATH_INFO: `/v3/projects/fd85f0a0eb06452c8e8c19728890dd98/users/10c9cfa503424dce99910e4beaad508d/roles/1dfe960ebfa348b0b382df38a5b0ff55` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:35:59.716861 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd85f0a0eb06452c8e8c19728890dd98, user_id=10c9cfa503424dce99910e4beaad508d, role_id=1dfe960ebfa348b0b382df38a5b0ff55)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:35:59.720492 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51fa29-f7e4-4e38-866a-1d5bc2e83001 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:35:59.733340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1267/2571] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:35:59 2022] PUT /identity/v3/projects/fd85f0a0eb06452c8e8c19728890dd98/users/10c9cfa503424dce99910e4beaad508d/roles/1dfe960ebfa348b0b382df38a5b0ff55 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:00.423935 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:00.424499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:00.424499 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:00.453295 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] MFA Rules not processed for user `10c9cfa503424dce99910e4beaad508d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:00.454693 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:00.523382 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1305/2572] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:00.590136 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:00.590736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:00.590736 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:00.610507 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] MFA Rules not processed for user `31f25fc0ffc74698b07d69161b64cdff`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:00.611704 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:00.668568 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1268/2573] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:00.682468 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:00.683969 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:00.718372 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:00.757019 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc9a4-d6bc-4505-a82b-26e0320ba28b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:00.762436 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6a804b38ad04a8bb7045e397b4e1cfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:00.763032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:00.763311 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:00.763582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:00.771094 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:00.772702 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:00.781561 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1306/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:01.010343 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:01.011734 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:01.068020 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23db78-884d-400d-b035-0276ad98ffee None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:01.071553 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:01.072144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:01.072419 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:01.072723 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:01.074422 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:01.084500 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:01.085919 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:01.093656 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1269/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:10.777551 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=19 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:11.090252 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:16.831797 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:16.833262 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:16.889405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8e1dd-4896-4b88-b743-0d1164ffc4bf service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:16.892988 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:16.893613 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:16.893894 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:16.894165 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:16.903149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:16.904582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:16.914749 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1307/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:26.910162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=26 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:34.932329 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:34.933771 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:35.008696 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a9ea-9dc9-4a71-98c1-59e7b7bd955c service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:35.013761 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:35.014438 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:35.014783 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:35.015125 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:35.016884 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:35.029366 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:35.031040 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:35.042535 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1270/2577] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:35.491108 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:35.553485 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f491-3dca-4a41-a413-b475aafab41a service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:35.557995 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:35.558614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:35.558895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:35.559170 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] PATH_INFO: `/v3/users/31f25fc0ffc74698b07d69161b64cdff` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:35.560299 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f25fc0ffc74698b07d69161b64cdff)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:35.562207 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:35.607260 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f25fc0ffc74698b07d69161b64cdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.619124 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f25fc0ffc74698b07d69161b64cdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.625951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f25fc0ffc74698b07d69161b64cdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.633272 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f25fc0ffc74698b07d69161b64cdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.634028 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f25fc0ffc74698b07d69161b64cdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.639840 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1308/2578] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:36:35 2022] DELETE /identity/v3/users/31f25fc0ffc74698b07d69161b64cdff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:35.813360 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:35.824645 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1020a1-e2f2-4761-9aad-ca48a7a3e65a service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:35.881131 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:35.881686 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:35.881966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:35.882239 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] PATH_INFO: `/v3/projects/b542a38dd7ca4cb4a7dd5271efc6a423` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:35.883356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b542a38dd7ca4cb4a7dd5271efc6a423)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:35.885342 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:35.932168 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b542a38dd7ca4cb4a7dd5271efc6a423', 'request_id': 'req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.939066 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b542a38dd7ca4cb4a7dd5271efc6a423', 'request_id': 'req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.944979 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b542a38dd7ca4cb4a7dd5271efc6a423', 'request_id': 'req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.957004 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] The token cache is being invalidate because project b542a38dd7ca4cb4a7dd5271efc6a423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:36:35.957296 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.957935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:35.959624 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1271/2579] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:36:35 2022] DELETE /identity/v3/projects/b542a38dd7ca4cb4a7dd5271efc6a423 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:35.963526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:35.964948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:35.978623 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50fca0-8036-4359-b6e1-6a3d0ecadefa admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.034789 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.035434 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.035712 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.035986 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] PATH_INFO: `/v3/users/10c9cfa503424dce99910e4beaad508d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.037410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c9cfa503424dce99910e4beaad508d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.039346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.060163 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:36.086665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c9cfa503424dce99910e4beaad508d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.098596 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c9cfa503424dce99910e4beaad508d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.105392 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c9cfa503424dce99910e4beaad508d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.112618 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c9cfa503424dce99910e4beaad508d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.113226 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-61e408bb-f4aa-45a9-8d35-f54e7ea630da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c9cfa503424dce99910e4beaad508d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.119069 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1309/2580] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:36:35 2022] DELETE /identity/v3/users/10c9cfa503424dce99910e4beaad508d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:36.292410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.293880 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:36.307610 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99d2ea-e576-4c7b-ad15-d73bcf889aef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.325765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:36.368183 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.368928 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.369210 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.369484 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] PATH_INFO: `/v3/projects/fd85f0a0eb06452c8e8c19728890dd98` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.370606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd85f0a0eb06452c8e8c19728890dd98)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.372560 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.420234 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd85f0a0eb06452c8e8c19728890dd98', 'request_id': 'req-593c7e60-2810-42c0-ab16-09255bfcba5a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.427776 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd85f0a0eb06452c8e8c19728890dd98', 'request_id': 'req-593c7e60-2810-42c0-ab16-09255bfcba5a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.433363 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd85f0a0eb06452c8e8c19728890dd98', 'request_id': 'req-593c7e60-2810-42c0-ab16-09255bfcba5a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.444955 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] The token cache is being invalidate because project fd85f0a0eb06452c8e8c19728890dd98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:36:36.445244 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.445903 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-593c7e60-2810-42c0-ab16-09255bfcba5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:36.447362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1272/2581] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:36:36 2022] DELETE /identity/v3/projects/fd85f0a0eb06452c8e8c19728890dd98 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:36.452197 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.452504 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.452787 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.472422 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:36.473763 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:36.531882 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1310/2582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:36.540144 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.540431 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.540740 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.561147 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:36.562349 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:36.570971 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1273/2583] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:36.575193 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.585482 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e6f88-1d29-4b1a-a56f-1a6d689c6ebc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.590088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.590684 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.590966 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.591244 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.591893 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:36:36.592199 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.593825 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.605528 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1311/2584] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:36:36.609782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.619595 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a345f98-3adc-4c59-88dc-8a8d02f09ba4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.624250 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.624866 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.625146 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.625417 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.626054 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.628558 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.655683 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1274/2585] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:36:36 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:36:36.659837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.670169 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8898-79d9-4932-ac53-a196b021c960 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.725411 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.726007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.726288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.726564 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.727196 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.729159 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.751552 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1312/2586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:36:36 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:36:36.755830 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.766237 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94a822-0086-4ac9-bd81-757e8daee776 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.771037 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.771625 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.771905 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.772197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.772883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.774512 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.785361 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1275/2587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:36.789744 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.800852 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777bb6-ddac-4d66-98cb-7888582585c9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.805534 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.806128 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.806405 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.806677 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.807313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.808948 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf69bb-2890-4049-996a-050d15e80a50 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.819408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1313/2588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:36.823506 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:36.833598 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb005ee-448a-4ac6-a48a-402729373c02 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:36.838166 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:36.838809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.839088 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.839362 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] PATH_INFO: `/v3/projects/1b6b1fc1835c4e9794e158e1f7885a50/users/47a67bba8d804f78abf6249ce4bd3397/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.854399 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6b1fc1835c4e9794e158e1f7885a50, user_id=47a67bba8d804f78abf6249ce4bd3397, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:36.857085 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:36.870340 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1276/2589] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:36:36 2022] PUT /identity/v3/projects/1b6b1fc1835c4e9794e158e1f7885a50/users/47a67bba8d804f78abf6249ce4bd3397/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:36.881357 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:36.881667 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:36.881937 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:36.889867 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:36.910410 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] MFA Rules not processed for user `47a67bba8d804f78abf6249ce4bd3397`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:36.911649 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:36.976792 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1314/2590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:37.010555 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:37.012243 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.065084 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:37.070277 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce2e22-423b-49d8-ad43-e604bc8f4c3b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:37.074953 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:37.075773 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.076219 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.076559 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.085081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:37.086542 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa28370-656c-46c0-88bf-604858b450a8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:37.095087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1277/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:37.111040 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:37.172910 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815eec-c37f-4eea-b96e-c3c8d8ee0131 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:37.178136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:37.178752 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.179029 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.179307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] PATH_INFO: `/v3/users/47a67bba8d804f78abf6249ce4bd3397` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.180674 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a67bba8d804f78abf6249ce4bd3397)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:37.182666 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:37.229665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a67bba8d804f78abf6249ce4bd3397'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.241458 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a67bba8d804f78abf6249ce4bd3397'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.248155 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a67bba8d804f78abf6249ce4bd3397'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.254961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a67bba8d804f78abf6249ce4bd3397'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.255610 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a67bba8d804f78abf6249ce4bd3397'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.261502 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1315/2592] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:36:37 2022] DELETE /identity/v3/users/47a67bba8d804f78abf6249ce4bd3397 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:37.266069 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.266358 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.266635 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.286311 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:37.287753 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.344509 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1278/2593] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:37.354664 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:37.356030 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.370428 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:37.415346 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231332b-84a6-46ba-be47-0bbe3928fdc8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:37.418954 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:37.419548 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.419820 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.420088 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.428998 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:37.430408 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbe0a-cab8-44f9-9071-d7ea6c7a9f33 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:37.439565 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1316/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:37.712765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:37.714226 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.728697 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033584e6-6ca4-481f-a1ff-77093b12a87e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:37.734122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:37.734780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.735057 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.735324 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] PATH_INFO: `/v3/projects/1b6b1fc1835c4e9794e158e1f7885a50` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.736551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6b1fc1835c4e9794e158e1f7885a50)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:37.738488 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:37.802699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6b1fc1835c4e9794e158e1f7885a50', 'request_id': 'req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.810718 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6b1fc1835c4e9794e158e1f7885a50', 'request_id': 'req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.818220 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6b1fc1835c4e9794e158e1f7885a50', 'request_id': 'req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.831494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] The token cache is being invalidate because project 1b6b1fc1835c4e9794e158e1f7885a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:36:37.831780 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.832450 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0eefcc12-7aa6-4773-a077-8e46d8bbeb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:37.834278 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1279/2595] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:36:37 2022] DELETE /identity/v3/projects/1b6b1fc1835c4e9794e158e1f7885a50 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:37.839806 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.840327 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.840533 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.860865 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:37.862149 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.922705 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1317/2596] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:37.930910 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.931197 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.931476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.951547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:37.952782 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:37.960692 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1280/2597] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:37.964764 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:37.974510 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b10819-8f42-40b4-b884-c0eda0030779 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:37.978996 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:37.979577 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:37.979884 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:37.980154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:37.980828 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:36:37.981127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:37.982696 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:37.994493 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1318/2598] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:36:37.998582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.008333 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5b670-8c2b-45dc-9486-b2b21e64b0c6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.013090 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.013680 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.014240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.014240 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.014899 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.016809 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.043588 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1281/2599] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 19:36:38.048027 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.058526 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9cb55-9ab4-4eab-a39a-56e41e2978b8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.113632 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.114220 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.114496 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.114767 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.115375 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.117320 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.137989 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1319/2600] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:36:38 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:36:38.142175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.152421 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3c178-e4cb-43bd-a1fd-6908c9786a8b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.157070 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.157658 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.157939 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.158212 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.158916 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.160582 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.170651 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1282/2601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:38.175045 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.184837 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1b293-2fd5-4e2e-b20b-5d45490cc8ef admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.189423 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.190656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.190917 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.191192 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.191843 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.193479 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059fccf-2beb-424e-9a1f-f0108596df3e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.204227 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1320/2602] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:38.208133 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.217952 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4c7c-5903-476e-aa40-62f012eca94a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.222538 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.223174 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.223456 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.223733 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] PATH_INFO: `/v3/projects/f339b1eedb0248c482017e02b7f82bae/users/9ea4b0c00176443289745b2be121393d/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.239755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f339b1eedb0248c482017e02b7f82bae, user_id=9ea4b0c00176443289745b2be121393d, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.242455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.255606 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1283/2603] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:36:38 2022] PUT /identity/v3/projects/f339b1eedb0248c482017e02b7f82bae/users/9ea4b0c00176443289745b2be121393d/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:38.265916 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.266200 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.266475 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.294348 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] MFA Rules not processed for user `9ea4b0c00176443289745b2be121393d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:38.295581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:38.305143 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:38.358950 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1321/2604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:38.371106 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:38.372824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:38.383638 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:38.434021 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903bf7-cfd8-436a-8d6d-f4ce61a2102d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:38.437652 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:38.438253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:38.438533 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:38.438805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:38.446966 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:38.448377 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8952-e9ce-4f62-b526-d8337775cecd service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:38.456937 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1284/2605] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:41.009352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.070676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74e64-667a-4692-ac02-cd6b0c89f73e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.075032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.075650 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.075924 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.076194 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] PATH_INFO: `/v3/users/9ea4b0c00176443289745b2be121393d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.077344 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea4b0c00176443289745b2be121393d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.079236 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:41.123492 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea4b0c00176443289745b2be121393d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.135834 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea4b0c00176443289745b2be121393d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.142722 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea4b0c00176443289745b2be121393d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.149768 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea4b0c00176443289745b2be121393d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.150466 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea4b0c00176443289745b2be121393d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.156484 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1322/2606] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:36:41 2022] DELETE /identity/v3/users/9ea4b0c00176443289745b2be121393d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:41.161185 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.161660 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.161757 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.181316 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:41.182494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:41.239135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1285/2607] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:41.248695 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.250065 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:41.284211 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:41.308883 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc85cb-52d1-491b-bd6d-b317737f0237 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.312409 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.313035 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.313321 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.313582 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.322574 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.323922 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad46c68-fac2-4837-8630-efe4ecfd086e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:41.333349 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1323/2608] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:41.600981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.602557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:41.616981 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cabce-2d70-4152-a72d-8467b7141138 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.621800 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.622646 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.622934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.623206 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] PATH_INFO: `/v3/projects/f339b1eedb0248c482017e02b7f82bae` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.624356 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f339b1eedb0248c482017e02b7f82bae)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.626346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:41.675043 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f339b1eedb0248c482017e02b7f82bae', 'request_id': 'req-0d761762-8bec-4e4a-84ac-d38b15fe8868'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.682667 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f339b1eedb0248c482017e02b7f82bae', 'request_id': 'req-0d761762-8bec-4e4a-84ac-d38b15fe8868'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.688339 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f339b1eedb0248c482017e02b7f82bae', 'request_id': 'req-0d761762-8bec-4e4a-84ac-d38b15fe8868'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.699859 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] The token cache is being invalidate because project f339b1eedb0248c482017e02b7f82bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:36:41.700149 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.700824 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d761762-8bec-4e4a-84ac-d38b15fe8868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:36:41.702286 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1286/2609] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:36:41 2022] DELETE /identity/v3/projects/f339b1eedb0248c482017e02b7f82bae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:41.709982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.710274 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.710555 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.730855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:41.732059 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:41.794433 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1324/2610] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:41.801929 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.802282 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.802622 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.822359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:41.823546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:41.831970 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1287/2611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:41.836254 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.845898 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8712b15-bc2c-4f75-b855-9e43d497f52e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.851127 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.851704 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.851983 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.852257 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.852941 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 19:36:41.853248 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.854816 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:41.866508 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1325/2612] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 31 19:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 19:36:41.870430 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.879703 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b0e1e-bbcb-4584-9386-46e76a0f4be1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.884359 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.885005 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.885291 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.885557 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.886193 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.888076 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:41.915486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1288/2613] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 31 19:36:41 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:36:41.919550 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:41.929509 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795300-aa0f-4189-8684-a9febae339e6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:41.985289 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:41.985889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:41.986168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:41.986498 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:41.987136 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:41.989084 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:42.011099 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1326/2614] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 31 19:36:41 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 19:36:42.015305 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:42.026233 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936a9b-7afd-476a-887b-0429e77d6f79 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:42.031122 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:42.031725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:42.032010 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:42.032315 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:42.033063 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:42.035717 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:42.037257 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:42.048787 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1289/2615] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:42.052601 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:42.062399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4579e4-1875-4c41-9660-ea664a6d0b88 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:42.067781 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:42.068368 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:42.068681 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:42.068961 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:42.069614 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:42.071213 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810a213-9946-4329-b9ef-82234cc29b2f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:42.082457 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1327/2616] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 31 19:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 19:36:42.086453 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:42.097071 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35b6e-d93c-4982-99e7-75ad0a7233f5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:42.101654 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:42.102330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:42.102611 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:42.102886 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] PATH_INFO: `/v3/projects/42c874cabd3c4fd780a1661477356e89/users/876f9198c293497d87ef1f7fb10531c4/roles/97a257abeb7a4ede9a810f05489b076d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:42.117821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c874cabd3c4fd780a1661477356e89, user_id=876f9198c293497d87ef1f7fb10531c4, role_id=97a257abeb7a4ede9a810f05489b076d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:42.120494 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:42.134161 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1290/2617] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 31 19:36:42 2022] PUT /identity/v3/projects/42c874cabd3c4fd780a1661477356e89/users/876f9198c293497d87ef1f7fb10531c4/roles/97a257abeb7a4ede9a810f05489b076d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:36:42.144809 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb42c-4e92-4b6f-945f-e4601333ea54 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:42.145116 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb42c-4e92-4b6f-945f-e4601333ea54 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:42.145418 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb42c-4e92-4b6f-945f-e4601333ea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:42.172168 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a94cb42c-4e92-4b6f-945f-e4601333ea54 None None] MFA Rules not processed for user `876f9198c293497d87ef1f7fb10531c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:42.173388 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a94cb42c-4e92-4b6f-945f-e4601333ea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:42.201399 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:42.236328 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1328/2618] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:42.247455 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:42.249242 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:42.307798 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f562-3827-49d0-bfa8-ede8d480158a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:42.311384 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b15ab0375434a93834a3591da357114', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:42.311975 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:42.312253 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:42.312551 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:42.321394 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:42.322821 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:42.331934 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1291/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:43.687794 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:43.688313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:43.688313 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:43.707951 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] MFA Rules not processed for user `876f9198c293497d87ef1f7fb10531c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:43.709162 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:43.716171 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1329/2620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:36:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:43.752690 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:43.754950 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:43.836050 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f947be6-a41c-41af-9b00-da1d44a42e94 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:43.839584 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8c5ebd3eb4d1cab97c3d1eaff3f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:43.840175 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:43.840451 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:43.840752 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:43.842446 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:43.908913 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:43.911285 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:43.913284 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5c0a-8fb7-43a4-a1cf-ac870a608774 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:43.925280 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1292/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:44.363644 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:44.365414 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:44.426970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586ff6-856a-4b04-b43d-0b75a94b5f6e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:44.430513 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:44.431119 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:44.431394 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:44.431665 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:44.433352 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:44.447010 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:44.448427 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:44.460007 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1330/2622] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:36:53.920755 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:54.454364 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=43 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:36:57.989060 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88904b-97ae-4f49-be39-1e39324088e6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:57.989578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88904b-97ae-4f49-be39-1e39324088e6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:57.989578 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88904b-97ae-4f49-be39-1e39324088e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:58.041765 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dd88904b-97ae-4f49-be39-1e39324088e6 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:58.042890 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dd88904b-97ae-4f49-be39-1e39324088e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:58.107768 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1293/2623] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:58.153247 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:58.154646 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:58.242637 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b670a3-9b31-4f5a-8541-e2230ee7541b service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:58.247557 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:58.248151 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:58.248429 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:58.248739 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:58.256656 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:58.258218 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:58.266079 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1331/2624] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:36:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:36:58.767912 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cf0f0-aa18-4cfd-bcf3-8165982be222 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:58.768199 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cf0f0-aa18-4cfd-bcf3-8165982be222 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:58.768503 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cf0f0-aa18-4cfd-bcf3-8165982be222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:58.788951 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a09cf0f0-aa18-4cfd-bcf3-8165982be222 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:58.790198 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a09cf0f0-aa18-4cfd-bcf3-8165982be222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:58.797486 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1294/2625] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:58.810024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:58.821736 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcd7bd-f7c7-4f30-87e7-a39da587acd3 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:58.827033 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:58.827630 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:58.827908 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:58.828182 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:58.836676 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:58.838234 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:58.846446 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1332/2626] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:36:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 19:36:59.068143 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d749e-538f-4e63-96f7-6b2948f1aad2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:59.068631 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d749e-538f-4e63-96f7-6b2948f1aad2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:59.068805 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d749e-538f-4e63-96f7-6b2948f1aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:59.088525 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-541d749e-538f-4e63-96f7-6b2948f1aad2 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:59.089725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-541d749e-538f-4e63-96f7-6b2948f1aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:59.096883 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1295/2627] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 31 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:59.109058 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:59.119909 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67461b-7a28-4970-b3a6-3f8d0109c0e3 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:59.125104 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:59.125723 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:59.126024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:59.126298 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:59.135905 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:59.137583 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:59.145846 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1333/2628] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:36:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:36:59.488087 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:59.488379 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:59.488725 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:59.508543 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] MFA Rules not processed for user `3a68508a30c44df59cf10908c9a82eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:36:59.509781 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:36:59.517191 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1296/2629] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 31 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:36:59.531871 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:36:59.545307 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450c3b-a026-4558-bf44-d972762be04b service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:36:59.551361 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23a46239196c40d1a1529909da19d0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:36:59.551994 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:36:59.552276 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:36:59.552581 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:36:59.562868 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:36:59.564855 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f70fd-c2d3-4dc3-8a1d-e56ec8574753 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:36:59.576970 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1334/2630] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 31 19:36:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 19:37:01.729410 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:37:01.792081 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ece58-7f1c-4dbd-b406-0883ab43f8e5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:37:01.796841 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:37:01.797476 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:37:01.797784 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:37:01.798083 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] PATH_INFO: `/v3/users/876f9198c293497d87ef1f7fb10531c4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:37:01.799264 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876f9198c293497d87ef1f7fb10531c4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:37:01.801322 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:37:01.847326 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876f9198c293497d87ef1f7fb10531c4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:01.852544 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:37:01.854698 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876f9198c293497d87ef1f7fb10531c4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:01.868330 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876f9198c293497d87ef1f7fb10531c4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:01.869034 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876f9198c293497d87ef1f7fb10531c4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:01.875935 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876f9198c293497d87ef1f7fb10531c4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:01.882461 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1297/2631] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 31 19:37:01 2022] DELETE /identity/v3/users/876f9198c293497d87ef1f7fb10531c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:37:01.886889 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:37:01.887343 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:37:01.887477 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:37:01.906189 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] MFA Rules not processed for user `c283501180e146e19c1574f09f326f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 19:37:01.907383 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:37:01.964288 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1335/2632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 31 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 19:37:01.973973 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:37:01.975348 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:37:02.031547 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54bfce-61be-4d1a-9f35-42f24ec5cef4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:37:02.035265 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f9f85aeb8642f2b2b97aff5d1be0e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:37:02.035858 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:37:02.036135 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:37:02.036403 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:37:02.045433 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:37:02.046855 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:37:02.056619 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1298/2633] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:37:02.219024 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:37:02.220441 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:37:02.232895 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95dc41-5a2c-4f75-a1b7-e535684dca70 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:37:02.239154 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283501180e146e19c1574f09f326f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefddd72ecfc4b63a01173e7a0408933', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:37:02.239790 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:37:02.240068 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:37:02.240340 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] PATH_INFO: `/v3/projects/42c874cabd3c4fd780a1661477356e89` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:37:02.241490 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c874cabd3c4fd780a1661477356e89)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:37:02.244032 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:37:02.276725 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:37:02.294578 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c874cabd3c4fd780a1661477356e89', 'request_id': 'req-55b1899f-5dde-4227-9bb3-343326345a38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:02.302611 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c874cabd3c4fd780a1661477356e89', 'request_id': 'req-55b1899f-5dde-4227-9bb3-343326345a38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:02.308762 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c874cabd3c4fd780a1661477356e89', 'request_id': 'req-55b1899f-5dde-4227-9bb3-343326345a38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:02.319014 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] The token cache is being invalidate because project 42c874cabd3c4fd780a1661477356e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 19:37:02.319302 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:02.319930 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-55b1899f-5dde-4227-9bb3-343326345a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 19:37:02.321445 dv-cinder-863097-1-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1336/2634] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 31 19:37:02 2022] DELETE /identity/v3/projects/42c874cabd3c4fd780a1661477356e89 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 19:37:12.052546 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=35,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:37:12.315982 dv-cinder-863097-1-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:39:08.237246 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 19:39:08.238629 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:39:08.376178 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74c265-0926-41af-bb4d-27c108eb74ae service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 19:39:08.434815 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582fecc260bd4947994cb41bc05ca111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137766e22d354d53b86e53deba57ec8f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 19:39:08.435414 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 19:39:08.435694 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 19:39:08.435967 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 19:39:08.437699 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 19:39:08.449346 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 19:39:08.450921 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd91297-5661-45dc-87ce-d0150ca8364b service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 19:39:08.460991 dv-cinder-863097-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1299/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 31 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 19:39:18.456392 dv-cinder-863097-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}